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(54) riUe: SYSTEM AND METHOD FOR DELIVERY OF VIDEO DATA OVER A COMPUTER NETWORK 



(57) Abstract 

A video clip storage and retrieval system whereby video clips, 
stored locally and/or at a more remote location, can be requested 
and retrieved by a user at the user's multimedia terminal. When 
le user requests a desired video clip, the request is processed by 
a primary index manager ('PIM") via a Local Search and Retrieval 
Unit ("SRU**). Before the message is communicated to the PIM, 
the local SRU checks its own storage to sec whether the requested 
video clips arc available locally. If some of the video clips arc 
local, the local SRU still forwards the request to the PIM so that the 
PIM may detemiiine specific video clip usage. The PIM determines 
the extended SRU where the audio-visual data is stored and passes 
this information to a Data Sequencing Interface ('DSI"). The DSI 
collects the video clips and downloads the clips to the user's tcnninal. 
The user may then view, copy, or print the video clip as desired. 
In a preferred embodiment, a distributed digital video dip delivery 
system, according to the invention, provides video clips stored at local 
and/or remote locations, which can be requested from the Internet 
and retrieved at the user's multimedia terminal. When the user 
requests a desired video clip shown on a Web page, the request is 
diverted to a primary index manager ("PIM**). The PIM attempts to 
locate the closest server containing the requested clip, from which 
the download is completed. The system further includes means for 
uploading and distributing clips to geographically diverse servers, 
dynamic load balancing, subscription management mechanisms, and 
protection means to discourage unauthorized duplication of video 
clips. 
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10 SYSTEM AND METHOD FOR DELIVERY 

OF VIDEO DATA OVER A COMPUTER INfETWORK 

The invention relates to a distributed audio/ video clip storage and 
retrieval system, and more particularly, to a system whereby video material, stored 
15 locally and at a remote location, can be requested and retrieved at a user's multimedia 
terminal with or without sound and associated database information. In a preferred 
embodiment, the invention provided a system whereby remotely stored audio and video 
content can be requested and retrieved from a server selected so as to maximize 
network capacity and minimize transmission delays; 

20 

BACKGROUND OF THE INVENTION 
This application is a contmuation-in-part of Serial No. 08/486,517, fded 

June 7, 1995. 

The Internet is a loose network of connected computers spread 
25 throughout the world. A message can be sent from any computer on the Internet to 
any other by specifying a destination address and passing the message from computer 
to computer via a series of "hops." Each computer, or "node," on the Internet has a 
unique Internet address. When an intermediate computer receives a message in transit, 
the computer checks the intended destination of the message and passes it along 
30 accordingly. 
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The Internet is growing, in terras of both size and sophistication, at a 
rapid rate. In the past, most users of the Internet were academic, research, or 
institutional users; the Internet was primarily used at that time to transmit and receive 
electronic maU and network news and to allow transfer of computer files. 
5 However, since the introduction of the World Wide Web (also known as 

the "Web" or the "WWW") several years ago, the Internet has begun to host 
increasing amounts of other types of data of general interest, namely representations of 
images, articles, etc. 

The Web presents a graphical user interface to the Internet. "Web 
10 pages," often consisting primarily of text and graphical material, are stored on 

numerous computers, known as "Web servers," throughout the Internet. These Web 
pages are generally described, in terms of layout and content, by way of a language 
known as "HTML" (HyperText Markup Language). Any particular computer linked 
to the Internet can store one or more Web pages, i.e. computer files in HTML format, 
15 for access by users. 

A software program known as a "browser" can be used to access and 
view Web pages across the Internet by specifying the location (i.e. Internet address) of 
the desired Web page, or more commonly, by "hotlinking" to Web pages. Common 
browsers are Lynx, NCSA Mosaic, and Netscape Navigator. , n,e desired Web page 
20 is specified by a uniform resource locator ("URL"), indicating the precise location of 
the HTML file in the format "http://intemet.address/directory/filename.html", 

HotlinMng is accomplished as foUows. TTie user first accesses a Web 
page having a known address, often on the computer located at the user's ISP antemet 
Service Provider). ITie ISP is the organization providing Internet comiectivity to the 
25 user. ^Tiat Web page can contain, in addition to textual and visual data specified in 
HTML format, "links," or embedded information (in the form of URLs) pointing to 
the Internet addresses of other Web pages, often on other computers throughout the 
Internet. TTie user, by selecting a link (often by pointing and cUcWng with a mouse) 
can then access other Web pages, which can in turn contain ftiither data and/or 
30 additional links. When a Web page is accessed, its information is transmitted from the 
remote computer, wherever in the world it may be located, across the Internet, to the 
user. 
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In recent times, the Web has begun to host highly sophisticated types of 
multimedia content, such as audio and video data. Various extensions to HTML, such 
as Netscape's EMBED tag, allow references to other data to be embedded'into Web 
pages. Some browsers are not capable of handling data other than text and images. 
5 Other browsers can handle the data in various ways. NCSA Mosaic, for example, 
handles references to unknown types of data by aUowing the data to be downloaded to 
the user's computer, and then optionally invoking an external program to view or 
manipulate the data. Recent releases of Netscape Navigator take the concept one step 
ftiTther: a browser extension, or "plug-in," can be automatically invoked to handle the 
10 data as it is received from the remote Web page. Other means, such as network 

program "applets" written in the Java language (or a simUar language), can be used to 
extend the functionality of the browser environment or network. 

Compared to first generation Web content, namely text and still images, 
audio and video data have extremely high storage and bandwidth requirements. In 
particular, video fdes can be very large, from approximately 10 megabytes to 10 
gigabytes. In order to play video fdes at speeds approaching their recorded rate at a 
user's terminal, the files have to be deUvered at a fast, constant speed. Too slow, and 
the image plays back slower than originally recorded. If the speed is uneven, then the 
video appears jerky, like an old-time movie. At present, it is difficult, if nd^ 
impossible, to provide sustained high-speed transmission of large files over a multi- 
node link on the Internet. Because the data is often transferred from afar, many 
factors can cause the delay or even loss of parts or aU of a transmission. 

This attribute, combined with the rapid growth of the Web and the 
Internet in general, has led to several problems. There is now a high and increasing 
volume of Internet traffic caused by Web page access, and the demand for bandwidth 
already exceeds supiply. 

Furthermore, certain content on the Web is extremely popular. Because 
current Internet technology provides Web pages from specific or "dedicated" remote 
site or servers, the most popular sites are often overloaded. Furthermore, according to 
current Internet technology, each response to a user request is generaUy transmitted 
separately. In other words, if one hundred users request transmission of the same Web 
page at the same time, one hundred separate transmissions must be made to these 
users. Because many of these popular Web pages are often being transmitted across 
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many nodes on the Internet, there can be substantial dupUcation, delays and lost 
requests, for both the requested data and other, unrelated data being transmitted over 
the same routes. If a Web server containing video data receives many simultaneous 
requests for its ability to transfer aU of the files at fuU speed is impaired. 
5 Accordingly, a need exists for a system capable of providing improved 

access to audio/video content on the Internet or another general purpose network. 
Such a system would take steps to ensure that content is deUveied without delay or 
intemiption to all users requesting it. 

The prior art is primarily directed towards text or image database 
10 providers, and so-called "video on demand". These systems are not designed to store 
text and video or audio-visual data across multiple computer systems in a distributed 
network. The "video on demand" concept is based primarily on a host-client 
architecture for downloading real-time audio-visual data, in very large amounts at a 
very high speed. Such systems aim, for example, to provide fiiU-length movies, with 
15 sound, to on-line subscribers. Typically, remote usen communicate with large main- 
frame servers containing the audio-visual data. niehost-cUent architecture of such 
systems stems from the desire to eliminate bandwidth limiting elements in the system 
by locating the video data solely on the provider's high-capacity system. The provider 
must then insure that hardware and software used to distribute this data is capable of^, 
20 the very high storage and transmission rates required, and is virtuaUy error free, so 
that no perceivable data is corrupted or lost. 

Known and proposed "video on demand" systems involve expensive and 
sophisticated computer and communication systems which are adapted to feed fuU 
length movies to attached subscribers "on demand." Such systems use a massively 
25 parallel computing architecture, in an attempt to adapt the multi-processing computing 
system to manage the monumental video data deUvery requirements of hundreds of 
simultaneous users. Each multi-precessing computer is a single "mainframe" computer 
and operating system with numerous intricately intercomiected individual 
microprocessors. TTie massively paiaUel computers also have very high speed internal 
30 data buses with the capability of sustaining a significant but fixed level of internal data 



traffic. 



Massively paiaUel systems pr^ent three distinct disadvantages: (1) 
reliabmty. (2) cost, and (3) they are not scalable. Since video data is highly storage 
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intensive, a very large number of hard drives are required to sustain the system. This 
requirement substantially increases cost. Further, because the hard drive is generally 
the most unreliable aspect of any computing system, using a large number of hard 
drives contributes significantly to making the overall system more unreliable. Also, 
5 due to the centralized systems basic structure, it is not scalable. 

Another system employing large mainframe servers to store the 
audiovisual data for delivery to a small number of users depends on reducing hard 
drive throughput by developing specialized hard drive interface software. This 
software determines how the computer's operating system uses the computer's hard 

10 drive. For example, multiple blocks of related data can always stored sequentially, 
instead of randomly. Although this may lead to more effective data throughput rates, 
such systems have the ability to accommodate only about 40 simultaneous users, and 
are geared to in house, small scale, video distribution. 

A limited or partial "distributed" architecture has been proposed, which 

15 would link multiple personal computers together in order to fashion a much larger 
monolithic ftmctional unit. In this system, video data is distributed only to build a 
single, much larger source of digital video information. For example, a long video is 
assembled "on the fly" from separately stored pieces on different machines. Such a 
system might subsequently use ATM switch technology to merge the output of this 

20 array of computers into one or more continuous video streams. 

By contrast, the invention provides a tnie or complete distributed 
architecture with increased reliability and the capability of supporting thousands of 
simultaneously attached users, at a fraction of the cost of the massively parallel 
system. In a preferred embodiment, the invention uses the existing Internet 

25 infrastrucnire, in conjunction with a network architecture as described herein, to 
achieve rapid and efficient delivery of audio/visual content to end users. 

The invention not only distributes unlike databases (for example, a 
related but distinct "text database" and "audio-visual database") across the assorted 
computing and communication devices, but it also partitions and distributes data in a 

30 manner which maximizes the performance of the network as a whole. 

In one embodiment of the invention, the user, a real estate agent, has 
the capability of receiving up-to-date audio-visual information about a listed property. 
Presently, a real estate agent spends hours researching relevant aspects of available 



wo 96/41285 



PCT/US96/10403 



6 



P<op=n,, ,0 include, fa^ecting u,= propeny, 

50p..e„, Of ho„„ ,„ed b«au„ Ctae con^. Addittona,*d.e and 

eff„„ ,3 spa« ascertaining the prospecrtve buyer's desires, introducing tl,c buyer ,o d,e 
r^gc „ communities avaiUbie witlua a ci^sen region, researching properties that the 
PO^.,,. buyer may be interested in, and then showing these pr„,,ties to the p„el 

According to the invention, a reallor-s time win be more effeclivelv 
directly related to selling proper^, no. on ttae intensive 
act.v,t,es necessary to stay abreast With market condidons. For e«mp,e, by bling abie 
» vew the property on a video terminal the realtor wiH reduce significanUy the tL 
^nt^hing potenua. properties, time spent visiting prc^enies w L the 

v„ he vtdeo Clip, ^s al.ow3 the realtor to devote more time to closing and ot^er 

.5 duaes associated With selling .he ptoperty. Also, having LvidJ^^^ 

"meval c.p3bi«,y ,,^3 ^ „ ^^^^^^ 

without having to revisit the pn^etty. ■ 



20 



SUMMARY OF THE INVENTION 

video clip storage and retrieval system 
Whereby the user receives comprehensive data coUected ftom one or more daLal by 

fotm of select^l vtdeo clips coupled with corresponding database information 

■^"''«""P'=*=val system is a distributed computer system or 
^--^--P^^-informaUon, stored locaa, and at a remote 
■ocanon, can be requested a«l viewed at a user's multimedia termmal. The system is 

( ™ SEUs ), data .equeocing imerfaces CDSIs"), local stonge and retrieval 
"-(•'o-' ^^tls-,. and use. terminal modules. Each parUUon.^^,^:^ 

30 ~«*=ope.atio«andmanag«ne„t„fthesys,em,bu,are,!^neeessl7 
assigned to a specife physical computer or communicadon component 

■»°P'"'«'»'.>''«='fln. builds a request at a user termtaal. iteretMest 
.3 uan^uted to dte user's primary i„dex manager (-PiM-, via a .oca. storage and 
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retrieval unit (local SRU). The local SRU attaches a Regional Identifier to the request 
to assist the PIM to efficiently search for, locate and report on the requested 
information. The local SRU provides temporary storage for the user's most requested 
video clips, and before the query is sent to the user's PIM, the local SRU is poUed for 
5 requested video clips. The user query, amended to contain a Regional identifier and to 
reflect any local matches, is then forwarded, to the PIM. 

The PIM uses the Regional Identifier to identify remote IMs which may 
have the requested video information. The PIM also checks to see whether the video 
cUps stored at the local SRU are current. The PIM then queries its own video cUp 
0 Usting and the listing for the remote IMs to locate the requested information. A Ust or 
summary of aU available data responsive to the request is then transmitted to the user 
via the local SRU. The user may then update or modify the request to create an 
abbreviated list of video clips and/or other data the user wishes to view. 

The abbreviated user query is then passed to the PIM. The PIM, having 

) previously located each requested video cUp on other remote IMs, retrieves the 
requested video clips and displays them at the user's terminal by creating a DSI for 
each user that requests video clips that are not stored at the local SRU, and informing 
the DSI where the requested video clips are stored. The DSI coUects the requested 
video cUps from the appropriate extended and remote SRUs and transmits this 
information to the local SRUs. 

The requested video clips satisfying the user query are then displayed at 
the user's terminal. The user may display, copy, and/or save or print the results. 
Copies can also be made on standard video cassettes. In a preferred embodiment, the 
DSI has the capabiUty of resequencing the transmission order of video clips to further 
manage the demands on the system. For example, requested video data may be stored 
and retrieved at various locations throughout the system, at various distances from the 
user, and accessible through different networks or communications routes, with 
different bandwidths and transmission speeds. In a preferred embodiment, the DSI 
deteimines the most appropriate routes and schedules for downloading requested 
information, to provide fast and efficient service to the user without unduly taxing tiie 
shared components of the system. The PIM records how often particular video cUps 
are requested, and from this information determines whetiier those cUps should be 
duplicated at particular local SRUs for ready display. As video cUps are updated or 
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eliminated, the PIM makes the required updates to the database log. Also, the PIM 
keeps track of billing information for the users of the system. 

The invention is also directed to a video clip storage and retrieval 
system aUowing users to access data from Web or Web-like sites on the Internet or 
other network. 

First, specific Web page audiovisual contem is dissociated from its 
original server, and is distributed to numerous servers in geographically different areas 
having a relatively short distance (geographicaUy and electronicaUy) to the user's 
tenninal. This is facilitated by embedding a "video ID" in a Web page to indirecUy 
specify a video clip. A database is accessed to relate the video ID to the optimal 
server from which to download the clip. This is accomplished in such a way as to 
locate audio/video content on servers close to those users expected to lequest it 
thereby minimizing the number of networic nodes traversed. Furthermore, if ce'rtain 
servers are overloaded or out of service, the data is dynamically ledundant so the 
15 desired content can be efficiently retrieved from alternate sites. 

According to the present invention, data is distributed on the networic in 
a configuration responsive to historical usage, current usage, and predicted usage By 
optmiizmg these considerations, network traffic can be reduced and overloaded servers 
and communications links avoided. In addition, geographical servers can be 

20 establishedtoholdcUpsofparticuIarinterestforaspecificgeographicalregion and 
subject-matter servers can be established to hold clips pertaining to certain subject 



areas. 



Furthermore, frequentiy requested clips can be queued and multicast to 

multiple users at one time. niis. too. reduces network traffic and increases 

25 responsivity. 

Another aspect of the invention is its ability to aUow a user to interact 
with the retrieved video clip. Technology to physically manipulate video infonnation 
on personal computers is known. For example, video capture boards can receive a 
video signal fn,m a television or VCR and can store video data for later editing or 
30 viewing. Video boards and systems of this kind can employ compression protocols 
such as "MPEG" (Motion Picture Experts Greup) standards 1 and 2. and Motion ' 
"JPEG" (Joint Photographic Experts Group) to store and transmit video data in a 
highly compressed state. ITus reduces tiie storage capacity and transmission time 
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needed to work with the video data. Such systems aUow a user to view and edit video 
on a personal computer terminal, but unlike the present invention, do not provide the 
capability of selecting and retrieving desired video clips from remote locations at high 
speed. 

In a preferred embodiment of the present invention, the user establishes 
an account with a content provider or ISP. This account may be in the form of a 
subscription, a debit account, or any of numerous other known payment arrangements. 
When the user accesses subsciibed-to content through the system, the account can be 
updated. In this manner, the user can be billed for usage in any manner desired, 
subscription information can be tracked and preseived, authorization levels can be set, 
and data protection to prevent unauthorized use can be accomplished. 

The system may offer secondary audio visual information which would 
correspond to the requested video clips. In an illustrative appUcation within the real 
estate industry, the secondary audio visual information could be the schools, shopping 
centen, and hospitals situated in the vicinity of a requested property. The secondary 
videos are related to the primary audio-visual data or video clips through a coordinate 
system to minimize data entry, data storage, and the demands on the system's 
computational resources. 

Certain advanced embodiments also allows the user to perform "what 
if' alterations of the downloaded information, for example, allowing the user to show a 
potential buyer what a Hsted house would look like with a porch addition. 

In general, the user's ability to download video cUps is enhanced by the 
present invention. When the user wants to view a cUp, the video ID wiU be retrieved 
and sent to a regional database. If the regional database can match the video ID to a 
clip existing on a local server, and the user's subscription rights are sufficient, then the 
cUp will be downloaded from the local server. If the cUp is unavailable locally, or the 
local server is overburdened, then succeedingly more remote servers will be queried 
for the transfer. Accordingly, the fastest possible path wiU be selected, and traffic wiU 
be minimized on the network. 

Exemplary embodiments of this invention are directed to the real estate 
industry and to video deUveiy over the Internet. However, as will become leadUy 
apparent, the invention is appUcable to a wide range of end uses where convenient ' 
access to corresponding audio-visual information would be usefiil. For example, the 
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video clip retrieval system can be used for retail sales, dating services, travel services, 
and many other applications. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The features of the invention will be more readUy apparent from the 
following detailed description and drawings of an illustraave embodiment of the 
invention. 

Figure 1 is a block diagram showing a preferred hierarchy of the 

system. 

^'g"^ 2 is a block diagram illustrating how various modules of the 
video clip retrieval system may be addressed. 

Figure 3 is a flow chart iUustrating data sequencing interface logic for 
video clip storage management. 

Figure 4 is a block diagram of an embodiment of the presem invention 
15 implementing video clip deUvery over the Internet. 

DETAILED DESCRIPnON OF THE INVENTION 
Figure 1 illustrates a preferred embodiment of the video clip storage and 
retrieval system, showing its strucmral hierarchy and the various modules which. 
20 comprise the system. As shown, the system comprises one or more user terminals 14, 
a local storage and retrieval unit ("local SRU") 18. a data sequencing interface (DSI) ' 
30, one or more extended storage and retrieval units ("extended SRUs") 26. and one 
or more index managers ("IM") 22. 

By way of a system overview, video clips are stored primarily on 
25 extended SRUs 26, and are tracked and distributed by the IMs 22. A user obtains 
videos of interest by communicating with a primary index manager ("PIM") 22 via a 
local SRU 18. nie PIM 22 locates the requested video clips and creates a DSI 30 to 
direct the efficient download of the video cUps to the user terminal 14. n,e 
comiections between terminal 14 and the local SRU 18 can be within the same 
30 computer, or between two or more computers located within a building, which are 
linked together on a local area network. 

Exemplary software modules comprising each componem of the system, 
and databases associated with each software module, are depicted in Table 1. below. 
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Preferred and non-limiting embodiments of each module of the system are also 
described below, with reference to Figure 1 and Table 1, 
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TABLE 1 SO FTWARE MODUI^A DATABASE PARTTOO ?^ 

SOFnVAREMODUIjS J Lp^:ABASE J AROT^ 



USER TERMINAL 



Search and Query Interface 



Audio- Visual Display Interface 



Data Decompression Logic 



INDEX MANAGER 



IM Supervisory Process 



Text Database Management Log ic 
Storage Management Logic 



Message Routing Logic 



DSI & SRU Command Logic 



DATA SEQUENCING INTERFACE 
DSI Process 



Audio- Visual Sequencing Logic 



Index Manager Interface 



Extended SRU Interface 



Local SRU Interface 



EXTENDED SRU 



SRU Process 



IM Command Interface 



DSI Command Interface 



LOCAL SRU 



Search and Update Logic 



Regional Identifier Builder 



Audio- Visual Download Interface 
Compression/Decompression 



INDEX MANAGER 



Text Database 



IM List 



SRU List 



Audio- Visual Data Index 



Audio- Visual Access List 



EXTENDED SRU 



Active A/V Listings 



Inactive AJV Listings 



Secondary A/V Listings 



Remote A/V Listings 
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User Terminal 

A user terminal 14 is the user's interface to the system, and typically is 
a personal computer, workstation, or a television set top box. Terminal 14*is 
connected to or includes the local SRU 18, and sends the user's requests to the PIM 
5 22, after initial interrogation of local SRU 18. As shown in Fig. 1, terminal 14 
communicates with a PIM 22 to obtain requested audio-visual data, wherever the 
requested data is stored, e.g. on extended SRUs 26 or remote SRUs 38, and on 
different systems or networks at different communication and/or phone system 
addresses. Terminal 14 receives or downloads requested audio-visual information 

10 through the local SRU 18, 

As shown in Table 1, each user terminal 14 comprises a search and 
query interface, an audio-visual display interface, and audio-visual data decompression 
logic. The search and query interface provides the user access to a database or index 
which can be interrogated for desired video clips and other information. For example, 

15 in a real estate application, one such database could be the Multiple Listing Service 
(MLS), 

The audio-visual display interface provides a mechanism for the user to 
manipulate retrieved video clips. After requested video clips have been displayed on 
the user's terminal 14, the user may then interact with the system using, for example, 

20 a play, stop, pause, fast forward, fast reverse, forward and reverse metaphor. The 
user may elect to "jump" to specified locations within the clip, the locations being 
tabulated in a window on the user's terminal 14. Also, displayed in another window 
on the user's screen may be a list of available secondary options for user interaction. 

In a preferred embodiment, videos are stored and moved through the 

25 system in a highly compressed state and wiU be decompressed at the users terminal 14. 
The decompression logic utilized may be commercially available video decompression 
standards and protocols, for example, Motion Picture Experts Group ("MPEG") 
standards 1 and 2, MJPEG, Indeo, or Fractal. 

30 Local Search and Retrieval Unit (Ixjcal SRU) 

The local SRU 18 is the temporary storage location for video clips and 
for information downloaded from the extended and/or remote SRUs 26 and 38, for use 
at user terminal 14. As shown in Figure 1, user terminal 14 and local SRU 18 may be 
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combined as one computing system. In a preferred embodiment, the local SRU 18 is 
connected to one or more user terminals 14. each local SRU 18 being capable of 
supporting a large number of user terminals 14. For example, the local SRU 18 may 
comprise a fde server for a local area network, with one or more ir,tegral or com,ected 
5 storage devices. In such an embodiment, each terminal 14 interacts with the local 
SRU 18 via a networic comiection, e.g. as a network node, using conventional networic 
protocols and topologies. 

Suitable sKrage medU for use in a local SRU 18 include toe capacity 
hart dHves, .ch a. I, 2 or 5 gigabyte hard drives, high speed optical drives, RAID 
10 devtces, and other .nedia capable of storing locaUy a reasonable con,p,e.„„t of video 
cups for read, access and manipulati™,. Ponlons of the local SRU's 18 disk sto.a« 
capacity are designated as the stotage capadty requited ,o dupUcate a subset of ^ 
prunaty and remote M(„ audio-video data index databases. Ms infomtadon is used 
dunng .enninal queries to deterntine which video cUps ar^ stoted locally Video 
segment revision information is also maintained widdn d,e index database and is 
reotmcd to the IM during the query process in order to maintain video segment 
accu^cy. ,n d» evem ^ addiUonal stomge space is required, addiUonal disic storage 
may ^ provtded to the local SRU, to include storage capacity for active, inacdve 1 
secondaiy audiovisual listings. 

» Apart from storing audio-visual data, the local SRU 18 comprises local 

search and update logic, a regional identifier builder, an audio-visual data dowrtoad 
mterftce, and (6) compression/decompression logic CTable 1). 

Tie Regional Identifier BuUder component of local SRU 18 atuches a 
^Stonalcodeorldendfiertoeachuserrequest. The regional identifier allows the PIM 
25 ^.ocommumcate with specified remote IMS H and «,det«mine the locations of 
requested video clips sto„=d a, temote SRUs 38. In an embodunen. used to distn-bute 
.cal estate data, the regional identifier may be the Zff code of the property in the 
vtdeo segment. ™s information ma, be talcen dirccUy ft^n «,e text database I, will 
be apparem, however, that the (Regional ID) fleU can be keyed to an, convement 
«eg.,y or context-sensitive description suitable for dte type of informarion stored and 
tne desired end use, 

'^^""'"^■"to downloaded video cUps to the user terminal 14 
u> a htghly compressed state. In a preferred embodiment of the invention, this 
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operation is mediated fay an Audio-visual Download Interface associated with local " 
SRU 18 (Table 1), with decompression prior to and/or in "real-time" during viewing 
occurring at the user terminal 14. Local SRU 18, via its dowiUoad interface, also 
communicates with a DSI 30, described in more detail below. DSI 30 manages the 
download of video cUps and other information to local SRU 18 from the various 
locations where responsive information is found. 

The local search and update logic serves primarily two functions. First, 
it enables local SRU 18 to search its storage media for requested video clips before the 
query is transmitted to the PIM 22. The update logic allows the PIM 22 to identify 
whether the locally available video clip is current. Thus, when the user's request is 
transmitted to the PIM 22, the request is modified to indicate (1) whether the video 
segment is stored locally, and (2) the current Revision Code associated with the video 
cUp. If the PIM 22 locates a cUp that supersedes the one currently stored on the local 
SRU 18, the local SRU 18 is notified, the old data is deleted, and the new data is 
15 downloaded from the SRU 26 containing the updated video clip. 

A second function of the local search and update logic is to identify and 
track the most frequently requested audio-visual clips. These video clips are identified 
for continued storage within the local SRU 18. TTiis ensures that once a predetermined 
local SRU storage capacity is reached, only the most heavUy used video cOps are 
stored at the local SRU 18. In one embodiment of the invention, when a video cUp 
with higher usage than the least used locally stored cUp is identified, the Feast used cUp 
is replaced by the higher usage clip within local SRU 18. In another embodiment, 
local SRU 18 may store the last requested video clips, space permitting. A 
combination of these and other storage swapping and management approaches may be 
25 used. 

In a preferred embodiment, DSI 30 transmits infoimation in compressed 
form to local SRUs 18 for downloading to the user's terminal 14. The decompression 
is performed at the user terminal 14 using conventional decompression standards. 
However, where the user is using a television screen, or other unintelligent device, to 
30 receive the audiovisual data, the decompression, via commercially avaUable 
decompression standards (discussed above) will take place at the local SRU 18. 



20 
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Primary Index Mana ger _ . 

The PIM 22 h the primary search engine and database management 
module of the invention. As shown in Table 1, PIM 22 comprises (a) index manager 
supervisory process; (b) text database management logic; (c) storage management 
5 logic; (d) message routing logic; and (e) DSI & extended SRU command logic. The 
PIM 22 is designed so that no two functions must specifically reside on the same 
physical computer, although it will be apparent that in prefened embodiments certain 
funcuons may be convenienUy or efficienay grouped together conceptually and/or 
physically, for greater ease of use. 
^0 The "index manager supervisory process" (Table 1) is the software 

interface to the high speed communication interface (explained below). It provides the 
communication interface to the local SRUs 18 and to the text databases. When the 
user's query necessitates creating a DSI 30, the "index manager supervisory process" 
creates a DSI 30 on its computer system unless the "index manager supervisory 
15 process" determines that the currem state of high speed communications on its 

computer exceeds a predetermined limit, for example, 40-80 users. In that event, the 
DSI 30 is created on a different computer system. 

The "text database management logic" is incorporated from the text 
database in use with the system, and manages and controls text data stored within these 
20 databases. For example, in the real estate embodiment, the "text database management 
logic" is the logic associated with the Multiple Listing Service ("MLS") database, and 
is structured to allow MLS queries spanning the entire distributed network. 

The "storage management logic" is the system "storage engine" and is 
responsible for placing new and/or updated or uploaded audio-visual data on the most 
25 appropriate extended SRU 26. Audio-visual segments or clips can be stored to more 
than one extended SRU 26, when dupUcation would minimize traffic to and from local 
SRUs 18, for example over high speed network 24 or communication line 16. The 
decision to move or copy data to an extended SRU 26 from a remote IM 34 and SRU 
28, or from another extended SRU 26, is made for example by evaluating an algorithm 
30 which accounts for available storage space on the various SRUs 26, the demand for 
particular video clips, and the locaUons of users requesting the most popular videos. 
The "storage management logic" may also track parameters such as the cost of 
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transmitting and storing duplicate information, and helps to ensure that each extended 
SRU 26 is utilized efficiently, and that no extended SRU 26 becomes "overextended," 
The index manager "message routing logic" accepts regionalized queries 
from the local SRU 18, deciphers the queries, and subsequently forwards the 
5 disassembled queries to remote IMs 34. The index manager "message routing logic" 
also accepts the responses received from the remote IMs 34, formulates a 
comprehensive response, and relays this response to the user. 

The "DSI and SRU command logic" provides the IM 22 with the 
capability of directly communicating and controlling the DSIs 30 and the SRUs 26, 

10 The PIM 22 uses this interface to pass the data required to enable the DSI 30 to 
communicate with the extended and remote SRUs 26 and 38 to direct these SRUs to 
download video information. 

The "SRU Command logic" sees to the duplication of popular videos on 
alternate SRUs 26. It also places copies of video segments on SRUs geographically 

15 closer to the users most interested in those videos. The goal is not duplicate data onto 
SRUs 26 where the number of frequendy downloaded videos ("FDVs") is already high 
(above a predetermined value). Duplication of data is performed according to the 
following logic during non-peak periods of system operation. The PIM 22 determines 
whether it is managing an extended SRU 26 which has an FDV levefabove this 

20 predetermined value. This determination is made by searching through the "Audio- 
Visual Data Index" database (described below) to identify the video clips that have 
been accessed most frequently. From this video subset, videos are selected for 
transferal or duplication based on where the video was used most. If the FDV was 
transferred principally from DSIs 30 created by the PIM 22, extended SRUs 26 located 

25 within the same computer are evaluated to determine whether that extended SRU 26 
can accept a duplicate copy of the video clip. If so, the FDV is duplicated on the 
identified extended SRU 26. 

Extended Storage and Retrieval Unit fExtended SRUi 
30 As noted above, extended SRU 26 is the principle storage facility for the 

system and is used to store audio-visual data in a plurality of audio-visual storage 
media. Although this section refers primarily to the extended SRU 26, the term 
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- includes remote SRUs 38 which may also store requested audio-visual information, 
The software modules are identical. 

The most requested audiovisual data, to include the FDVs, are'written in 
contiguous allocation blocks closest to the system's disk storage allocation table. 
5 Inactive video segments are stored in contiguous allocation blocks fiinhest away from 
the "disk storage allocation table," In an alternative configuration, the disk storage 
allocation table is maintained in RAM or on a sqparate computer. Disk storage is 
organized in macro storage cells which insure that each video segment will always be 
stored in contiguous allocation blocks. This may be achieved, for example, by using a 
10 storage cell capable of storing a two minute audiovisual segment. 

Referring to Fig. 1, one or more extended SRUs 26 are connected to 
the PIM 22 and to each terminal-unique DSI 30, in the event that the PIM 22 
determines that a DSI 30 should be created. The extended SRUs 26, upon direction of 
a DSI 30, transmit requested data, via the DSI 30, to an appropriate local SRU 18, and 
15 ultimately to user terminal 14. 

The extended SRU 26 comprises an SRU supervisory process, an IM 
command interface, and a DSI command interface. The SRU supervisory process 
enables the extended SRU 26 to communicate directly with the IMs 22 and DSIs 30. 
This interface responds to messages and data packets addressed to it. It also 
20 encapsulates, for network transmission purposes, video data to be transmitted to other 
SRUs 26 or DSIs 30. The SRU supervisory process allows the SRU 26 to store data 
transferred to it. Similarly, the SRU supervisory process can delete all out of date or 
unnecessarily dupUcated data. This storage and deletion of data arc performed under 

the direction of the PIM 22 via the "IM Command Interface," - 

The "DSI command interfaces" exist to aUow the PIM 22 to function 
apart from the extended SRUs 26, The DSI command interface is provided to direct 
the extended SRU 26 to download the audio-visual information to the DSI 30 transmit 
buffers for eventual download to the user terminal 14. 
Data Sequ encing Intarface fPSn 
^® According to the invention, each DSI 30 is created by the PIM 22 to 

facilitate data transfer from the extended and remote SRUs 26 and 38 to the user 
terminal 14. When created, the DSI 30 may reside within the extended or local 
components of the system, but in the preferred embodiment of Figure 1 is shown 
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locally. The DSI 30 collects, manages, and buffers data which is transmitted from 
both extended SRUs 26 and remote SRUs 38 to the local SRU 18, and then 
downloaded to the user's terminal 14. * 

A DSI 30 is created and/or initialized by PIM 22 whenever a user 
5 requests audiovisual information that is not stored within the local SRU. In a preferred 
embodiment, the DSI 30 is created just prior to the video data download process, and 
destroyed immediately thereafter. This allows the system to use one communication 
network for querying and another, preferably higher bandwidth, communication 
network for video data downloads. For example, the D channel ("X.25 packet" 

10 network) of an "integrated services digital network" ("ISDN") connection may carry 
the video querying traffic of the video network, to include forwarding the user query 
to the PIM 22, and receiving the response from the PIM 22. Once the user has finally 
determined which video clips are to be retrieved, the PIM 22 identifies the most 
appropriate and efficient location for the DSI 30 and then creates the DSI 30 at this 

15 location. A detailed "DSI Video Download List" is then passed to the DSI 30 by the 
PIM 22. The DSI 30 uses this list to direct the SRUs to download the requested 
information. 

Also, the DSI 30 allows the network to connect many geographically 
distributed video data sources to one subscriber. destination. 
2° ^^SI 30 comprises (1) a DSI supervisory process, (2) audio-visual 

sequencing logic, (3) a PIM interface, (4) an extended SRU interface, and (5) a local 
SRU interface. 

The DSI supervisory process enables the DSI 30 to communicate 
directly with the PIM 22, the extended and remote SRUs 26 and 38, and the local 
25 SRUs 18. 

The "audio-visual sequencing logic" for DSI 30 operates broadly as 
shown in Figure 2. The "audio-visual sequencing logic" enables DSI 30 to resequence 
data, to provide for more efficient use of the storage and retrieval units. The object is 
to allow the system to utilize idle resources throughout the network. The DSI 30 
30 actively determines which computing systems and communication paths to the user 
should be used for each download. Thus, if a particular extended SRU 26 is busy 
supporting other users, the PIM 22 may create a remote DSI 42 on a remote system 
for user terminal 14, Remote DSL 42 would then communicate with user terminal 14, 
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assume responsibility for the download process, and direct the video data download to 
user terminal 14. 

The "index manager interface" provides (1) the command interface 
between the PIM 22 and the DSI 30, and (2) the feedback mechanism between the DSI 
5 30 and the PIM 22. In the first instance, the PIM 22 uses the "index manager 

interface" to communicate instructions to the DSI 30 in order for the DSI 30 to collect 
the requested video information. In the second instance, the DSI 30 reports back to 
the PIM 22, informing the PIM 22 of the status of each queried extended SRU 26. 

The "extended SRU interface" aUows the DSI 30 to direct the identified 
10 extended SRUs 26 to download requested infonmation to DSI 30 transmit buffers, for 
download to the user terminal 14. This interface is typically a very high speed 
interface, for example, FDDI or "FireWire." 

The DSI 30. uses the local SRU interface to coordinate its video 
segment download with the local SRUs 18. The communication interface between the 
DSI 30 and the local SRU 18 is typically a high speed interface, for example, ISDN. 
Also, when the traffic around the PIM 22 is high, the DSI command logic establishes, 
via the local SRU interface, a remote connection with a local SRU 18 (discussed 
above). 



15 



20 DATABASE STRUrTTTT?F5; 

The system may employ relational or flat-file databases, text indexes 
and/or search engines, and raw data in the form of audio-visual cUps and/or text 
information. Field-oiiented databases may be used in the system, and in represeming 
such databases each field can be shown enclosed by parentheses. For example, (Field 
25 1), (Field 2) represents a database with data fields 1 and 2. If the database is related 
to another database, the relating field can be denoted with square brackets (Q). Thus, 
in the foUowing example. Database 2 is related to Database 1 through field 3. 

Database 1: (Field 1), (Field 2), [Field 3] 

Database 2: [Field 3], (Field 4), (Field 5) 

^ P^sent invention, the PIM 22 software is designed to contain the 
following database stnictores: (1) a Text database; (2) an IM list; (3) an SRU Ust; (4) 
an Audio-visual data index; and (5) an Audio-visual Access Kst. 
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In an illustrative embbdimeht of the invention, the user, via the PIM 22, 
has access to at least one "text database" containing records with searchable fields, one 
of which is [Video ID]. Each record in this database corresponds to a video clip 
stored on the extended or remote SRU 26 or 38. This database may be maintained by 
5 the system or by one or more third party databases, for example, the Multiple Listing 
Service (MLS) database, and using any suitable data management "front-end." 

The "IM list" (Table 1) is a hierarchical database storing information 
needed to target specific databases during data queries, and serves to identify remote 
IMs 34 containing requested audio-visual data. The "IM list" is structured as follows: 

10 (IM Address), [Regional ID], (Alternate Address). 

Because regional data may span multiple remote IMs 34, there may be multiple remote 
IM entries in the PIM list database. The (IM Address) helps locate the appropriate 
remote IM 34 within the network. The [Regional ID] allows the PIM 22 to 
communicate with remote IMs 34 identified as containing information relating to the 

15 requested regional identifier. This reduces the number of servers contacted, thereby 
reducing messaging that occurs over the high speed network 20. The regional ID is 
obtained during construction of the query by the local SRU 18 software modules. In 
certain embodiments of the invention, (Alternate Address) field is a system phone 
number, electronic address,, or other path to the remote IM 34 in the event that other 

20 third-party database providers are used. 

The "SRU list" is structured as follows: 
(SRU Address), (SRU Under-run Count Rate), (SRU Access Count Rate). 
The (SRU Under-run Count Rate) is used to track the number of times during a 
predetermined period, for example, a 24 hour period, that the extended SRU 26 or 

25 remote SRU 38 were not able to fulfill data requests because the SRUs were busy 
downloading data to fulfill other data requests. The (SRU Under-run Count Rate) will 
be explained below in the SRU monitoring discussion. The (SRU Access Count Pate) 
monitors how often during a predetermined time interval, a particular SRU is used for 
video delivery. 

30 The "audio-visual data index" identifies each video clip and specifies its 

location. The "audio- visual data index" is structured as follows: 

[Video ID], (SRU Address), (Location Code), (Revision Code), 
(Initial Copy Flag), (Usage Count Rate), 
[Secondary Array ED] 
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As above, the [Video ID] is a unique reference identifier for each video clip and 
corresponds to an identifying field within the text database. The (SRU Address) 
identifies the network location of the SRU containing the requested audio-visual 
infonnation. The (Location Code) is the exact physical location of the video clip 
5 within the SRU. The (Revision Code) indicates whether this version of the video clip 
is the current version. The Gnitial Copy Flag) is a field that is appended to each new 
video clip entry, so that the system knows that this version may only be updated, 
duplicated, or removed to more remote storage locations, but not deleted from the 
database entirely. The (Usage Count Rate) keeps track of how often a particular video 
10 cUp is requested during a predetermined time interval, for example, a 24 hour period. 
This infonnation is used to determine FDV states. TTie [Secondary Array ID] is used 
to point to a "related" database of secondary or related video or text information (not 
shown). 

Thus, in an embodiment where secondary informaUon is provided, such 
15 as the real estate embodiment, the user may enhance the available text and audio-visual 
data by providing additional information about the requested data. For example, in a 
preferred embodiment directed towards the real estate appUcation, the secondary' 
database may contain audio-visual infonnation about hospitals, schools, and traffic 
patterns, etc. associated with any requested property video. 

In the real estate example, the secondary database may be organized as 
follows: 

[Secondary Array ID], (Segment Coordinate) 
The [Secondary Anay ID] provides a way for the PIM 22 to flag were additional 
secondary data is available. TTie (Segment Coordinate) indicates the geographic area 
25 corresponding to the secondary information. ITie boundaries of this geographic area 
may be represented by latitude and longitude coordinates either taken from a map or. 
preferably, taken by GPS. Because the geographic area would tj^jicaUy encompass ' 
multiple property listings, each entry in the secondary database would correspond to 
several video clip entries. 

'^^ "audio-visual access Ust" is comprised of the following fields: 
(Video ID], (IM Address), (Access Rate) 



20 



wo 96/41285 



PCT/US96/10403 



23 

This database maintains a list of DSI 30 supporting "computer systems," by virtue of 
the managing or nearest IM address to which audio-visual infonnation was delivered. 
The DSI 30 requests data from many SRUs. When a DSI has successftilly*collected 
data from a particular SRU, its managing IM's "audio-visual access list" database is 
updated to reflect that video segment delivery to that physical location within the 
network. The network now has information representing the destinations of specific 
video segments from specific SRUs. This information is used to determine the most 
meaningful destination for videos and/or copies of videos distributed by the network 
storage management logic. 

Apart from providing the primary storage location for the video clips, 
the extended SRU 26 comprises an "active A/V listing," and "inactive A/V listing," a 
"secondary A/V Usting," and a "remote A/V listing. " The purpose for each of these 
listings will be explained in relation to a real estate application. In the real estate 
context, new property listings are typically of greater interest to the user and, 
therefore, would comprise the "active A/V Usting." Older property listings would not 
be selected as frequently and would comprise the "inactive A/V listing." However, a 
change in the property status, for example, reducing the price of the property may 
return the property to the "active A/V listing," The "secondary A/V Usting" would 
comprise the secondary information associated with certain video cUps. The "remote 
A/V Usting" would typically comprise property that has already been sold. This 
information would stUl be useful for comparative pricing purposes, but would be 
accessed relatively infrequently. 

The audio-visual data stored on the extended SRU 26 is the video cUp 
itself. In a preferred embodiment of the invention, video data is stored on the 
extended SRU 26 in storage blocks equivalent to approximately two (2) minutes of 
audio-visual data. The actual length of these storage blocks varies and is dependent 
upon the video deUvery appUcation. Audio data is also stored on the SRU in blocks of 
similar length. The entire audio and video segment may be stored contiguously, with 
the video and audio data being stored either separately or together. 

The local SRU contains a "local audio-visual index" and "actual audio- 
visual data." Audio-visual data stored on the local SRU 18 is organized in the same 
manner as the data stored on the extended SRU 26. The "local audio-visual mdex" 
comprises the following data fields: 
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[Video ID] , (Location Code)/ (Revision Code) 
•me [Video ID] conesponds to a field in the text database, and identifies the video 
clip, nie (Ixjcation Code) specifies the exact storage location of the video clip within 
the local SRU 18. The (Revision Code) indicates whether the stored version of the 
5 video clip is cunent. 

When the DSI 30 is created, the PIM 22 transmits a data structure that 
identifies the requested video clips, and the exact locations of each video cUp. The 
data structure is as follows: 

10 T"^^ ^ ^*^'^")' (Loc«ion Code), (SRU 

^" Access Count Rate), (SRU Under-run Count Rate) 

The [Video ID], (IM Address). (SRU Address), (SRU Access Count Rate) and (SRU 
Under-run Count Rate) serve the same functions as previously described. The [Video 
ID] field is the principle field, with the remaining fields being supporting fields to the 
15 [Video ID] field. TT.e (location Code) is the precise video storage address within the • 

SRU. Smce it is possible for each video segment corresponding to a unique [Video 
ID] to have multiple unique storage locations, the DSI 30 may have multiple records 
for separate storage locations for that video segment within the DSI's 30 video data 
download structure. n,us, if one SRU cannot respond to the DSIs command because 
20 u is busy, downloading audio-visual infonnation to fulfill another request. then the-DSI 
30 smiply retrieves the requested video cUp from another location. 

STORING A vrmrrt r^y TP 

When a new video clip is received, the PIM 22 must first determine 

25 /'hich extended or remote SRU 26 or 38 wmsto,^ the audio-visual infonnation TT,e 
PIM 22 identifies the IMs 34 supporting that video segment's region by comparing the 
regional identifiers. TTie PIM 22 then checks to see whetiier these SRUs have 
available FDV storage. TTus is because most new video clip listings wiU fall into the 
FDV category. If sufficiem FDV storage is found, the video clip is stored on that 

30 SRU (26 or 38), and the supervising IM's (22 or 34) A/V Data Index database is 

updated. However, if no suitable stomge is found, the PIM 22 will determine the SRU 
with the lowest FDV allocation and store the video to that SRU. 

A video cUp is stored as foUows: (1) A video is transmitted to an SRU 
26 for storage; (2) the "SRU supervisory process" writes the information to the disk 
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and returns the storage location of the data to the PIM 22 (the fonnat of the storage 
location message is dependent on the type of file: UNIX, DOS, etc); and (3) the PIM 
22 writes the video clip's storage address into "A/V data index" database oh the PIM 
22. 

5 

RETRIEVING A VIDEO CLIP 

Figure 3 provides a summary of how a preferred embodiment of the 
invention would operate to search and download data. The user first builds a data 
query at the user terminal 14 from the text database. For example, in the real estate 

10 application, the user would specify a selected property criteria from the MLS. Once 
constructed, the query is transmitted to the PIM 22 via a local SRU 18. The local 
SRU 18 modifies the query in the foUowing ways: (1) attaches a regional identifier to 
the query; and (2) searches its own database and flags each request that is stored at the 
local SRU 18 by appending a Revision Code to the request. The audio-visual data 

15 index also specifies the exact locations of the audio-visual data stored at the extended 
SRUs 26 and, via the remote IMs 34, the locations of video data stored that the remote 
SRUs 38. The PIM 22 uses the regional identifier to identify which remote IMs 34 
contain the requested video segments. Each identified remote IM 34 processes the 
query, returning a list or summary of available audio-visual references to the PIM 22. 

20 The PIM 22 also uses the Revision Code to determine whether the video segment 
stored at the local SRU 18 is the most current copy available. The PIM 22 
subsequently downloads a list of all available video clips to the user's terminal 14, 
indicating which video clips are immediately available by virtue of the fact that a 
current copy of the video segment is stored at the local SRU 18. 

25 Using the list of matching database records and audio-visual references, 

the user identifies and selects individual records or groups of records for further 
viewing and manipulation. This abbreviated list is transmitted to the PIM 22. The 
PIM 22 creates a DSI 30 and communicates the exact storage location of each 
requested video clip to the DSI. The DSI 30, in sequential fashion, queries each 

iO extended SRU 26 and remote SRU 38 (if applicable) communicating the exact video 
clip location to the SRU. TTie DSI 30 may have multiple address locations for each 
requested video clip, some locations being on the extended SRUs 26 and other 
locations being on remote SRUs 38. The DSI 30 will first attempt to collect the video 
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Clips from the extended SRUs 26 before attempting to retrieve similar information 
from the remote SRUs 38. TTie affected SRUs downloads the requested data to the 
tzansmit buffers of the DSI 30. where a predetermined number of video cUps may be 
stored in RAM until the local SRU 18 is ready to receive the infonnation Th, dsi 30 
5 updates the SRU access counter and transmits this information to the PIM 22 for use in 
momtoring demands on the SRUs. Once the data has been received by the local SRU 
IS. the local SRU 18 downloads the video cUps to the user terminal 14. 

In the evem that the queried SRU is presently busy deUvering data the 
DSI 30 may either use the alternate video address to attempt to retrieve the requested 
10 video clip from another SRU. or else moves on to retrieve the next requested video 
segment. Whenever an SRU fails to deUver the requested video clip, the DSI 30 
mcrements the SRU under-run counter for that SRU and eventuaUy communicates this 
mformation to the PIM 22. If the SRU under-run count exceeds a predetermined 
threshold value (communicated to the DSI 30 upon creation), the PIM 22 directs 
15 further requests away from this affected SRU by having the DSI 30 query alternate 
SRUs for the video cUp information. In the event that the video cUp is only stored at 
this location, then a delay wiU be encountered as the DSI 30 waits for the video 
mformation to be downloaded. TTie PIM 22 will also direct that the number of FDVs 
be decremented for this affected extended SRU 26. 
20 " In addition, since the SRU under-run count parameter identifies the 
location of "over-accessed" SRUs, audio-visual data will be moved or copied from 
these heavily loaded SRUs to more lightly loaded SRUs (based on their under-rtm 
levels), in an effort to distribute or flatten SRU demand. TOs load management 
^ process wiH occur during off-peak hours. H^e SRUs selected for copies or transferal 
25 of data will be identified from video usage information obtained from the "Audio- 
Vrsual Access Ust" located on the PIM 22. 

Data is preferably (1) maintained on the extended SRUs 26 which are 
most often queried for that data. (2) dupUcated on local SRUs 18 which most often 
request the data, or (3) may be duplicated on other remote SRUs 38 as space aUows 
This supply and demand approach, mediated by PIM 22 in response to DSI monitoring 
u^uts, provides fast access to the most requested information and efficiem storage with 
a maximum of usefirl redundancy without waste or loss of performance. Alternatively 
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the network may also be configured to always store each audio-visual entry in at least" 
one other location (space providing). TOs redundancy introduces improved throughput 
and offers improved reliability. • 

5 COMMUIsnCATION TNTERFACFS 

In a preferred embodiment, as shown in Figure 1, the system provides a 
plurality of extended SRUs, each of which communicates with the Primary Index 
Manager (PIM) 22 and the Data Sequencing Interface (DSI) 30. This provides a 
flexible, high capacity, high throughput system which can be readUy expanded as 
10 needed, and can provide for efficient distribution and backup of video clips and other 
data on the system. Also as iUustrated in Figure 1. the video clip system may 
communicate with other systems, for accessing video cUps or other data stored at 
remote locations. 

Communication between the PIM 22 and the remote index managers 
(IMS) 34 is primarily concerned with queries and results of queries, and is facilitated 
in a preferred embodiment by a very high speed network 20, for example, the Fiber 
Distributed Data Interface ("FDDI") which approaches speeds of 100 megabits per 
second. The PIM 22 communicates with the extended SRUs 26 via a similar very high 
speed network 32 where the extended SRUs 26 are located^on the same computer as 
the PIM 22. Alternatively, other networks may be used, for example a veiy high 
speed ATM network in embodiments where the extended SRUs 26 are distributed in a 
wide area network (WAN) configuration. The PIM 22 further communicates with the 
local SRU 18 via a high speed network 16, such as ISDN. Whenever a DSI 30 is 
created, PIM 22 communicates with the DSI 30 via network 36. and like PIM 22 
communication with extended SRUs 26, is via a very high speed interface (for 
example, FDDI, FireWire, or ATM). 

Communicaaons between the extended or remote SRUs 26 or 38 and the 
DSI 30 arc via a very high speed interface 24, for example, FDDI. This 
communication interface supports the throughput of vast amounts of audio-visual data. 
In contrast, the communication interface 28 between the DSI 30 and the local SRU 18 
is less demanding, and may be via a high speed (ISDN) interface. It is preferable that 
the communication interface 28 between the DSI 30 and the local SRU 18 be at least 
56 KBAUD to support the "real time" video requirements of approximately 15 f p.s. 
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Typically, the local SRU 18 and the user terminal 14 are located in the same cdraputer 
providing for a very high speed communications interface. 

The remote IMs 34 are linked to their own extended SRUs, shown as 
remote SRUs 38 in Figure I. Remote SRUs 38 communicate with reraotl DSIs 42. 
other local SRUs 44. and other user terminals 48 according to the same flexible 
hierarchy as the extended and local design described above. 



EXAMPT.KS 

Representative non-limiting examples of the invention foUow, and 
illustrate how the invention can advantageously be used. . It wiU be readUy Ippaiem 
that, in addition to these examples numerous other appUcations of the video clip 
retrieval system are possible and are within the scope of the invention. 

15 Example 1 . Real F«!tat<» 

In an embodiment of the invention for use with real estate data, the user 
would use a property database like the MulUpIe Listing Service as the primar^ text 
database, to determine the properties the user wishes to investigate. The user 
formulates an Initial search query which is transmitted to the local SRU 18 n,e local 
20 SRU-attaches the Regional ID to the query, which, in this appUcation, may be the UP 
code(s). map, Cartesian, or GPS coordinate(s) associated with the requested properties. 
The local SRU 18 also searches its own storage facilities to determine whether the 
requested video clips are stored locally and. if so. attaches a Revision Code to 
available video clips. This enhanced query is transmitted to the PIM 22. The PIM 22 
25 (1) updates the video cUp usage tables; (2) uses the Regional ID to efficiently 

determme from among many remote IMs 34. which remote IM 34 has any information 
relevant to the enhanced query; and (3) uses the Revision Code to determine whether 
the locally available video clip is up-to-date. A list of available video clips is 
transmitted to the user. The user may then choose the video cHps the user desires to 
30 view, nus request is retransmitted to the PIM 22 via the local SRU 18. TTie PIM 22 
creates a DSI 30. indicating to the DSI 30 where the requested video cKps reside n,e 
DSI 30 directs the extended SRUs 26 to download the video clips into the DSI 30 
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transmit buffers. The video cUps are transmitted to the local SRU 18, and arc 
subsequently displayed at the user terminal 14, 

In this illustrative appUcation, any available secondary video may be 
cataloged according to the geographical region it supports. A Ust of secondary videos 
may be displayed in a "Secondary Video" window on the subscriber's terminal 
whenever the property video is viewed. When the user requests the secondary video, 
this request is transmitted to the PIM 22. The PIM 22 has already determined the 
location of the secondary video information. TTie PIM 22 either uses the previously 
created DSI 30 or it creates another DSI 30 and passes the location of the secondary 
videos to the DSI 30. The DSI 30 then directs the SRUs containing the secondary 
video information to download this information. 

In a further embodiment of the invention, the property's coordinates are 
obtained from previously estabUshed map data. In another embodiment, the longitude 
and latitude of each property is obtained using a Global Positioning System (GPS) 
system, for example when the property is being filmed, and may be recorded along 
with the property's corresponding text data. 

Example 7 - P rescription nnig Infnrmartnn 

Another application of the invention is directed towards pnividing online 
drag prescription infonnation to physicians. TraditionaUy. pharmaceutical companies 
have utilized ve^r expensive detail forces to physically meet with physicians to edu'cate 
them about proprietary medications. However. recenUy. with the tremendous 
downward pressure on prescription pricing, the rapidly rising costs of drag discovery 
and development, the speed of reverse engineering by competiton and the more liberal 
generic drag appn)val poKcy, drag companies can no longer afford a fiiU detail force 
to market their proprietary drags. At present, high quaUty video cassettes are 
PHKiuced about the drag, and are sent directiy to the physician in an anerapt to 
supplement the sales force. 

One embodiment of the invention pnjvides ready access to audio-visual 
information about various drags available to the physician. As with the real estate 
appUcation, a third party text database may be used, for example, an on-line version of 
the "Physicians Desk Reference." The physician may simply search through the on- 
line database and select a Ust of drags that the physician would like to view on video. 
The system will search for, locate, and download the requested audio-visual 



wo 96/41285 



PCTAJS96/10403 



10 



30 

infomation. The drug videos may serve a variety of functions. For example, the " — 
physician may use this audio-visual information to leam about new drugs, or simply to 
refresh or update their knowledge about existing drugs. Also, drug companies may 
place advertisements about promotional drugs on the video clips for use by the 
physician. 

Example 3 - Rpfail Sprvir-Ac 

Another application of the invention is directed towards the retail 
industry, for example, the sale, lease and/or rental of new and used automobiles. ITie 
text database could include a listing of automobUes, price data, performance data, etc. 
The video clip retrieval system would retrieve pertinent video cUps, thereby enhancing 
the available text database. Another appUcation in the retaU arena would be to provide 
multi-media information on businesses or services such as those Usted in the "yeUow 
pages." 

15 Example 4 - Per«;nnn«.l 

A further application could be directed to the personnel industry, where 
video presentations could be used to enhance available text information profdes on 
specified employees. Such information may encompass providing information to 
healthcare providers about existing and prospective patients. The system.may also be.. 
20 used to provide information about the healthcare providers to patients. These videos 
clips would help the patients/consumer make a selection, by providing a way to screen 
the physicians by providing background information on education and areas of 
expertise, as weU as providing a video depiction of the hospital or clinic. 

25 Example 5 - Dating fte.nrirf-M 

The dating service industry is yet anodier area where the video cUp 
retrieval system could be utilized. Video clips of potential "dates- could be shown by 
the dating service to assist customers in obtaining suitable partners. 

30 Example 6 - Traval .Sftrvirpg 

Yet another appUcation of the system is in the travel business where 
travel agents can access video clips of hoUday locations for customers to view. 
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Example 7 - Internet Example 

Figure 4 is a block diagram illustrating a preferred embodiment of an 
Internet-related video clip storage and retrieval system according to the present 
invention. The system includes a user terminal 50 and a local SRU 51, which is 
linked by a communication line 52 to the Internet service provider's ("ISP*s") head-end 
network communications interface 54. In a preferred embodiment, the interface 54 is 
an item commonly referred to as a network "tenninal server." The interface 54 can 
also be a network router, switch, hub, computer, or other communication device, 
capable of supporting a large number of user terminals. 

In one embodiment of the present invention, the terminal 50 is a 
personal computer running an HTML browser 82 with an audio-video decoding and 
playback "browser extension" 84 as described above. The browser 82 offers the 
necessary functionality to query and search data distributed across the Internet. The 
browser extension 84, in addition to offering audio-video display capabilities, possesses 
the logic required to access audio-video and other data organized and maintained by 
the local SRU 51, and to decompress audio-visual data derived from the present 
invention through the local SRU 51. As will be discussed below, the browser 
extension 84 further allows the user to interact with audio-video clips. 

The system also includes a PIM 64 and one or more extended SRUs 66. 
In a preferred embodiment, the PIM 64 includes a modified Web server 68 and a 
database management module 69. All of the foregoing components, including the 
interface 54, are connected to a regional head-end backbone 80 within the user's home 
region 81. The backbone 80 may comprise any of a variety of known physical 
network components, such as Ethernet and FDDI linked together by assorted switches, 
bridges, routers, and hubs. 

Also, on any computer connected to the backbone 80, one or more 
transient DSI processes 58 may be created. Such DSIs 58 may be created by the PIM 
64, as required, for each user receiving audio-video content by the invention. The 
backbone 80 communicates with the Internet 56 via one or more network routers 112. 

A neighboring region 89 is also shown. Like the home region 81, it 
includes an index manager ("IM") 88 hosting a Web server 93 and a database manager 
91, at least one extended SRU 92, transient DSI processes 94, and a router 95. The 
router 95 is connected to the Internet 56. In addition, the neighboring region 89 is 
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connected to the home region 81 by way of a high-speed dedicated line 96 between 
routers 112 and 95, allowing the SRUs and DSIs of the regions to communicate. ITie 
dedicated line 96 can be components of the existing Internet infrastructure or new 
communication lines added to supplement the Internet infrastructure. The neighboring 
region 89, like the home region 81, also has a head-end network communication 
interface 98 capable of supporting a large number of user tenninals. 

Note that the neighboring region 89 need not host its own IM 88. If the 
users local to the neighboring region 89 are low enough in number that the cost of 
maintaining an additional IM 88 is prohibitive, the PIM 64 for the home region 81 can 
be used to control the other components of the neighboring region 89 via the dedicated 
line 96. Furthermore, an "intranet" -like structure can be created by utilizing a single 
PIM 64 capable of controlling a number of regional groups of SRUs (such as extended 
SRUs 66 and 92). 

nie content provider's region 91 is also shown. It, too, contains an IM 
90 hosting a Web server 83 and a database manager 85, at least one extended SRU 
100. one or more transient DSIs 102, and a router 86, which is comiected to the 
Internet 56. ITie dedicated line 96 can also link the content provider's region 91 to the 
other regions 82 and 89. A head-end network communication interface 104 connects 
the content provider's region 91 to a number of users, including the provider who will 
upload audio-video content. 

The fimctions of the foregoing components wiU be discussed in further 

detail below. 



A. Operation from the User's Perspective 

Tlie user terminal 50 is tiie device through which a user interacts witii 
the deUveiy system. The terminal 50 typically is a personal computer, workstation, or 
television set top box. The terminal 50 is capable of rumiing a browser 82 such as 
Netscape Navigator, and when prompted to do so by the browser 82. can also run an 
audio-video playback application as a "plug-in- or browser extension 84. The browser 
extension 84 receives audio/video data in protected and compressed form, and provides 
a mechanism for the user to receive, unprotect, decompress, and manipulate (i.e. play, 
rewind, stop, etc.) retrieved clips. ITie browser extension 84 is also capable of 
transmitting data back to the network 80, either tiuough the browser 82 or 
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independently. In a preferred embodiment, the browser extension 84 uses functions 
provided by the local SRU 51 to communicate with the deUvery system of the 
invention. • 

A preferred embodiment of the present invention is contemplated for use 
as a premium subscription service. The end user subscribes to the premium service in 
order to be allowed access, and in one embodiment, the user is sent a configuration 
file to be stored at the user terminal 50. The configuration fde contains a unique 
subscriber identification number, as weU as the Internet address of the PIM 64 to be 
accessed by the user. The PIM 64 maintains information on the subscriber in a user 
database, namely the types of content subscribed to, user preferences, limitations on 
service, and billing information. 

In one embodiment the user database contains the following information 

for each user: 



Item Name 
Counter 

Player Number 

User ID 



Format 



numeric 



numeric 



numeric 



User Ratings 

Services Subscribed 

Subscription Date 
Expiration Date 

Maximum Charge 



numeric array 

numeric array 

date 
date 

numeric 



Description 

Primary index for the records. Each 
record represents one subscription 
account. 

Unique registration number for the 
browser extension 84 installed on 
the terminal 50. 

Unique number that identifies each 
subscriber to the premium service. 
This is a multiple-valued item such 
that multiple User IDs can be 
associated with a single player 44. 

The content acceptability ratings for 
a specific user. 

The list of services to which the 
user's account has subscribed. 

The initial subscription date. 

The expiration date of the 
subscription. 

The maximum monthly expense that 
can be incurred by the account. 
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Demographic Info 
Usage Info 



text array 
text blob 



Name, address, payment method, 
etc., used for billing. 

A log of all video clips accessed, 
including date and time. This is for 
baling and user characterization. 



The PIM 64 also maintains information on the audio-visual clips stored 
on its extended SRUs 66 in a clip database (corresponding to the "audio-visual data 
index" previously discussed). In one embodiment, the cHp database contains the 
following infonnation for each clip: 



Item Name 
Counter 

Video ID 

Extended SRUs 

Copyright 

Charge Mechanism^ 

Charge Parameters 

Expiration Date 

Size of File 
Date 

Time 

Category 



Format 

numeric 

text 

IP array 
boolean 
numeric- 
numeric array 
date 

numeric 
date 

time 

numeric 



Description 

Primary index for the records. Each 
record represents one video clip. 

The globally unique name of the 
video clip, as specified above. 

The IP addresses of all the extended 
SRUs 66 which contain the file. 

A flag to indicate that the file is 
copyrighted and must be protected, 

A code representing the mechanism 
for charging for the file (pay per 
view, one-time fee, etc.). 

The amount charged per use under 
the specified charge mechanism. 

Date after which the file is to be 
removed from the system. 

Size of the file, in bytes. 

Date the file was made by the 
content provider. 

Time the file was made by the 
content provider. 

The subject category of the file, 
used for load projections as 
discussed below. 
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Usage Count numeric array The historical frequency of clip 

access across days and hours, used 
for load projections. 

Segment Info text/numeric If the file is segmented, this is the 

array of segment descriptors and 
pointers into the file. 

Link Info text/numeric If the file has been annotated with 

links to other files, this is the array 
of link names, URLs, and pointers 
into the file. 

The PIM 64 also maintains information regarding each of its extended 
SRUs 66. Such information is stored in an SRU database as follows: 



Item Name Format 

Counter numeric 

IP Address IP 

Current Performance numeric 

Theoretical Performance numeric 



Descriptioa 

Primary index for the records. 
There is one record for each 
extended SRU 66. 

The Internet address of the SRU. 

A value that represents the current 
performance of the SRU. 

-•A value that represents the 
theoretical* maximum file delivery 
rate from the SRU. 



The user can, using the browser software 82 on the user terminal 50, 
browse the Web, accessing Web pages and selecting links as is known in the ait. At 
some point, the user may wish to access a video clip handled by the subscription 
service. This is done by accessing a Web page on a content provider's Web server 83 
or elsewhere. The desired clip may or may not be among those the user has 
subscribed to. 

The content provider's Web server 83 can automatically, on the basis of 
a combination of the user's and the ISP's subscription parameten known to the content 
provider, create customized Web pages for each user. This procedure is known in the 
art. Preferably, the custom Web pages can be created on the ISP's regional Web 
server 68 (part of the PIM 64), Such an action can be undertaken at regular intervals, 
for example daily or whenever new content is made available to the system, or 
immediately upon access by a user. By accessing custom Web pages, the user will be 
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infonned of what subscription content is available, based on subscription infonriation, 
contained in the user database discussed above. In this way, the ISP can create a 
"video guide" set of Web pages containing information the user is inteiested'in, 
including subscribed-to video clips. The information contained in the ISP's "video 
guide" can be integrated with the information stored on the user's local SRU 51, 
thereby providing a seamless view of aU content available. By selecting a link on the 
custom Web pages, the user can request a Web page containing subscription content, 
which will then be deUvered by the system of the invention, even if it is not present' 
within the user's region 81. 

At that time, the ISP's Web server 68 (or other Web server 83 or 93) 
begins to transmit the Web page to the user terminal 50 via traditional means over the 
Internet 56. Accordingly, data moves from the server (e.g. server 83) to the 
corresponding router 86 to the Internet 56 (across potentially many nodes) to the user's 
ISP's router 112 to the head-end communication interface 54, and eventuaUy to the 
terminal 50. A reference to a desired clip is embedded within the HTML of the Web 
page. When the user's browser 82, e.g. Netscape Navigator, receives the reference 
suppUed for example within an EMBED tag, an immediate request is made of the Web 
server 83 to transmit the embedded file. 

The type or format of the embedded fde.is analyzed by, the browser 82. 
Typically, this is indicated by an extension on the filename of the embedded file and is 
known in the art. If the desired file is a video clip, the local SRU 51 belonging to the 
terminal 50 and the browser extension 84 are invoked to receive the data. First, the 
local SRU 51 intercepts a video ID. a unique identifier specifying the seleaed cUp. 
which is stored within the EMBED field in the Web page. The local SRU 51 first' 
determines if the desired clip is already stored locally. If not. the local SRU 51 passes 
the video ID to the PIM 64 associated with the user's terminal 50. TTie local SRU 51 
then awaits authorization from the PIM 64 to proceed with a data transfer. 

The video ID consists of a multidimensional set of content- 
characterization coordinates plus a unique file name. The content coordinates enable a 
match with tiie regional IMs that have subscribed to that type of file, as wiU be 
discussed later. 



In one embodiment. Uie video ID is constructed from the foUowing 
portions: a text name of the file as defined by the content provider; the content 
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provider's account number as provided by the organization running the subscription 
service; a category coordinate, possibly a representation of a hierarchical portion of a 
category tree, a geographic coordinate used to determine where the file is relevant 
(e.g. a region, state, or city); a time stamp, and a time period over which the file is 
relevant. The foregoing characteristics are known at the time a file is made available 
to the present system, and will be discussed in detail below. 

In a preferred embodiment, the local SRU 51 passes the video ID to the 
PIM 64 in the following form: a "virtual URL" is constructed in the form "http://" 
plus the Internet address of the PIM 64, plus the user's subscriber ID number, plus the 
video ID. If the desired clip was located on the local SRU 51, then the virtual URL 
request will contain a further attribute specifying that a particular version of the file 
has already been located by the local SRU 51. The Netscape Navigator procedure 
NPN_GetURLNotify is available to accomplish sending this virtual URL to the PIM 
64; the virtual URL is constructed to be in a format that will be accepted by Netscape 
Navigator and other network browsers. Upon receipt by the PIM 64, the virtual URL 
is decomposed into the video ID and subscriber ID components, which are then used to 
access the PIM's internal databases. 

The PIM 64 checks the user's subscription rights in its user database, 
and if authorized and necessary, initiates a DSI process 58 to download the desired clip 
to the user's terminal 50. The PIM 64, having identified the clip corresponding to the 
video ID m its clip database, passes information to the DSI 58 regarding which 
extended SRUs 66 have the clip. The DSI oversees initiating the transfer process, 
ensuring that data is sent from the appropriate extended SRU 66 through the interface 
54 to the user's terminal 50, The data is then downloaded from the appropriate 
extended SRU 66 to the user's terminal 50, at which time the local SRU 51 will 
intercept and transfer the data to the browser extension 84, The browser extension 84 
can manipulate the data, store it in a storage area local to the terminal 50, or prepare it 
for viewing, as desired. If the PIM 64 determines that the user has not subscribed to 
the clip indicated by the selected video ID, no DSI process is invoked, and the local 
SRU 51 will be notified that either the clip must be downloaded directly from the Web 
page, as is traditionally done, or that the clip is entirely unavailable to that user. 

Accordingly, the PIM 64 exercises a managerial function in the present 
invention. The PIM 64 includes a database with detailed information on the clips 
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stored on the extended SRUs 66 associated with the PIM 64, for example, the Ibcatibh" 
and filename of each clip, and attributes such as subject matter, rating, file size, 
expiration date, charge information, etc. For clips not on an extended SRU 66, 
another IM database maintains a reduced level of information about every IM, namely 
the Internet address of the IM and the content coordinates of all audio-video files that 
it maintains. For example, a Ubraiy of "news:sports:baseball" clips might be 
maintained by several nearby and distant regional ISPs, including die one comprising 
the user's region 81. As previously indicated, the PIM 64 also has a user database 
which stores information on each of its users, namely subscription rights, authorized 
rating levels, accrued charges, charge limits, etc. Upon receiving a virtual URL from 
a user, indicating that the user wants to receive a cUp having a specified video ID, the 
PIM 64 accesses the user database to determine whether the user is vaUd. The PIM 64 
then accesses the clip database to determine, based on cUp attributes, whether the user 
has valid subscription rights and is authorized to download the desired clip. At this 
time, the PIM 64 can also check to determine if downloading the desired cUp will 
cause the user to exceed his charge limit. 

If any of the foregoing database checks fail, the local SRU 51 will not 
receive authorization for the download, and the reason for the denial wiU be 
transmitted from the PIM 64 to the browser extension 84 and browser 82 user interface 
via the local SRU 51 to advise the user. If alternative versions of the desired clip are 
available which would be authorized given the user's subscription limitations, the user 
can be presented with the option to download the alternative versions. 

Upon a determination by die PIM 64 that the user is autiiorized to 
receive the desired cUp or an alternative version, it is determined as noted above 
whether the file embodying the cUp has already been received and stored by the user's 
local SRU 51. If so, tiiat version of the file is compared agabst the current version 
stored in Uie cUp database on the PIM 64. If the fde at the local SRU 51 is current, 
no download is necessary, and the locally stored venion is transfenwl to die browser 
extension 84 for playback. If the file at the local SRU 51 is supeneded, expired, or 
non-existent, steps are undertaken to download die proper file to browser extension 84 
via the local SRU 51. 

The download is initiated by Uie following procedure. The PIM 64 
queries its clip database to determine on which extended SRUs 66 the desired cKp is 
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Stored. If the clip is available on more than one extended SRU 66, the extended SRUs 
66 are prioritized according to apparent load, with the least busy SRU 66 being given 
the highest priority. The PIM 64 then invokes a DSI 58, and provides it wfth a 
prioritized list of SRUs 66 that contain the data. 

The DSI 58 invoked by the PIM 64 selects the highest priority (least 
loaded) SRU 66 from the list provided by the PDM 64. The DSI 58 then oversees the 
transfer from the extended SRU 66 to the terminal 50 via the interface 54 and local 
SRU 51 ; it does so by addressing the desired video clip with the Internet address of the 
user's local SRU 51. If the DSI 58 determines that the selected extended SRU 66 is 
overioaded or unable to respond (e.g. has not responded before a timeout), then the 
DSI 58 attempts to use the next-highest priority extended SRU 66 until the download is 
successful or until its possibilities are exhausted. At that time, infonnation on 
download latency (i.e. which SRUs were unable to handle the download, and how long 
it took the successful SRU to begin the successful transfer) is sent back to the PIM 64, 
to allow the PIM 64 to dynamically recalculate priorities and apparent loads. 

The DSI 58 is a software process which, as indicated above, directs and 
oversees the download process. The DSI process 58 can be hosted by the PIM 64, an 
SRU 66, or a standalone server connected to the PIM 64 and extended SRUs 66. To 
reduce bandwidth needs for the present invention, multiple requests. for the same video 
clip from several users can be queued by the DSI 58 for a short period of time (for 
example, from one to fifteen seconds) before the clip is sent. During the queuing 
period, the DSI 58 can be receiving the clip data from the appropriate SRU 66. At the 
expiration of the queuing time, the DSI 58 can then multicast the clip to all of the 
users requesting the clip. To the extent that the path to all of the requesting users is 
the same (i.e. from the DSI to the head-end network interface 54), multicasting permits 
the use of only one transmission specifying the Internet addresses of all of the 
destination terminals. Multicast techniques will be discussed ftirther below in the 
section on uploading new content. 

Furthermore, the DSI 58 also supports data protection. To discourage 
distribution of copyrighted video clips by end-users of the present system, the DSI 58 
will falsify key data fields of the audio-video clip, such as the MPEG 
"sequence_header" data structure, with data designed to make playback difficult. The 
correct video stream configuration data will be stored in an encrypted state (via known 
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encryption methcds, such as DES and RSA) in the MPEG system structure "user 
stream" as defined by the MPEG specification. Similarly, data derived from the user's 
ID will be added to the video data (namely MPEG DCT macro blocks) as noise at 
various points along the stream, thereby watermarking the file. The locations of this 
data is defined by a string of random numbers having a seed number stored within the 
encrypted portion of the user stream, as discussed above. The seed number, in 
conjunction with the clip title or video ID, is also archived in the user database 
belonging to the PIM for later reference should it be determined that the user stream 
and user data block have been removed from an MPEG file. 

Note that not all files must be protected as indicated above; the existence 
of the scheme is panially contemplated as a deterrent factor. Furthermore, the 
watennarking enables authorities to track down copyright violators. As described 
above, the DSI 58 protects a clip based on specific user information obtained from the 
user database of the PIM 64. The user's browser extension 84 can unprotect the clip 
based on the same information. Accordingly, only the user requesting the clip can 
unprotect a protected clip. 

The protection and watermarking steps are optional; the present 
invention contemplates that certain clips (e.g. advertising, public service 
announcements, and uncopyrighted material) can be left unprotected. This would be 
indicated by an attribute in the clip database. In this case, the DSI 58 will not protect 
the clip, and the clip can be received, stored, and viewed at the user terminal 50 
without un-protection. Furthermore, the user could be free to redistribute such 
unprotected clips. 

As indicated above, a system according to the present invention can have 
muldple index managers for a large number of concurrent users in disparate 
geographical areas. Figure 4 illustrates three index managers: the PIM 64 belonging 
to the user's geographic region 81, an IM 88 belonging to a neighboring geographic 
region 89, and an IM 90 belonging to the content provider's region 91. 

If the user's PIM 64 determines that the desired clip is not on any of the 
extended SRUs 66, and the PIM determines further that the user has subscription rights 
to access files from other regions, then the PIM 64 will query the closest IMs (e.g. IM 
88) to determine if any of the remote SRUs 92 local to the other remote IMs have the 
desired clip. The query can be directed to those IMs which are likely to have the clip. 
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Each IM, including the PIM 64, maintains a database of all other IMs connected to the 
system. For each IM, the database includes the Internet address of the IM, and 
information on the types of files stored by the IM's SRUs. The fde type information 
can be stored in the form of content coordinate data, as previously discussed. 
Accordingly, by consulting the database, the PIM 64 can determine which IMs are 
likely to have the desired clip, and query only those IMs. 

Each of the queried remote IMs, such as IM 88, responds with a 
message indicating whether its SRUs 92 contain the file, as weU as information on the 
apparent load experienced by those SRUs 92. If the desired clip is found, the list of 
viable remote SRUs 92 wiU be transferred to the PIM 64. The PIM 64 will 
subsequently invoke a local DSI 58 with the SRU list to transfer the file to the user's 
terminal 50, as discussed above. 

If the PIM 64, after havmg queried the neighboring remote IMs, is still 
unable to locate the desired clip on an SRU 66 or 92, the PIM 64 will then contact the 
source IM 90, where the content provider first uploaded the file. The Internet address 
of the source IM 90 is provided in the clip database of the PIM 64. If the desired clip 
is still current (i.e. not expired or superseded), it will exist on one of the SRUs 100 
belonging to the source IM. A DSI 58 wiU then be invoked, as discussed above, to 
download the clip to the requesting user's local SRU 51 and terminal 50, 

As the video clip data is received, it is stored on local SRU 51 and 
concurrently sent to the browser extension 84 to unprotect and display the video clip. 
As discussed above, the local SRU 51 stores the data in protected form. 
Consequently, it is protected against unauthorized duplication by an end user. If there 
is insufficient capacity available in the local SRU 51 to store a requested clip, the 
search and update logic of the local SRU 51, discussed above, can delete some of the 
least-recently-used clips already stored to make room for the new data. 

In a preferred embodiment of the invention, the clip can be stored in an 
MPEG, AVI, or QuickTime file format. Such formats are weU-known in the art. and 
are capable of using various compression schemes. For example, MPEG 1 and 2 use 
the discrete cosine transformation scheme, and MPEG 4 is proposed to use wavelet 
compression. AVI and QuickTime files may generally use such schemes as Indeo, 
Cinepack, fractal, or wavelet compression. Accordingly, the browser extension 84 of 
the invention must be able to interpret and decompress files of all types used in the 
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- invention, although not all compression fonnats and schemes noted above need be 
used. 

If the user desires to view again a clip he has previously downloaded 
and that is still on the local SRU 51, the browser extension 84 can either allow the 
data to be unprotected and viewed again without cost, or cause the local SRU 51 to 
query the PIM 64 and update the billing records if the desired clip is one that must be 
paid for each time it is viewed. 

As a consequence of the foregoing scheme, network load is minimized 
as compared to traditional digital video deUvery systems. Many copies of a video cUp 
can be downloaded in parallel to users in separate geographic regions. The copies of 
the cUp exist on servers local to each user's region, and in general, are transmitted 
across fewer network nodes for each download. Furthermore, the extended SRUs for 
separate regions have unique communications paths, through each Internet service 
provider's head-end network, to the region's users. Accordingly, many separate 
downloads can be undertaken concurrently in separate geographical areas without 
impairing (or being impaired by) traffic conditions on the Internet 56 as a whole. 

In addition, as will be discussed in detail below, each IM, including the 
PIM 64, tracks the demand within its region for all clips. Clips that are infrequently 
accessed within a particular region can be deleted from the extended SRUs 66 and re- 
acquired from remote SRUs 92 or 100 only when necessary. In this way, local storage 
requirements are minimized. Accordingly, for the clips in highest demand, it is most 
likely that the data can be downloaded from an extended SRU 66; this is the fastest 
path. For lower demand cUps, the nearest remote SRUs 92 will be the ones first 
queried. The response times for remote SRUs 92 can be determined by interactively 
testing the communications links (analogously to the "ping" program) to the remote 
SRUs 92 having the desired clip. The testing process is a combination of the 
foUowing: the round-trip elapsed time for a test packet; available bandwidth 
determined by deUvering and receiving several packets; and the capacity of the remote 
SRU 92 as tcpoited. 
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B. Uploading and Distributing New Content 

The content provider is responsible for making content, namely video 
clips, available to the present system. A software tool is provided for thai purpose. It 
is contemplated that the content provider will begin with a video cUp in MPEG fonnat 
(or another known digital video fonnat). The content will then use the software tool to 
assign a video ID, a rating, language and content attributes, expiration dates, and other 
attributes to the clip, which will then be stored within the file representing the clip. 
The MPEG file can be one having multiple video and audio streams supporting various 
playback configurations. For example, different versions can be provided in different 
languages, having different playback resolutions, having geographically specific 
information (such as telephone numbers), and having various rating levels (e.g. by 
cutting out or editing objectionable portions within some of the versions). In a 
preferred embodiment of the invention, the data in the user database belonging to the 
PIM 64 is used to estabUsh which version of a clip is desired by the user; upon 
download, the DSI 58 is directed by the PIM 64 to decompose the clip file and send 
the proper version. 

The content attributes attached to the cUp are represented in the form of 
a hierarchy of subjects. For example, a cUp could be annotated as belonging to the 
content areas "News:Sports:BasebaU: Yankees." All four of these content areas would 
then be indicated in the clip database of the PIM 64, as weU as within the clip file 
itself. A wide variety of content areas would be pre-established by the organization 
providing the subscription service, for use by the coment providers prior to uploading 
cUps. It is fiirther contemplated that content providers having specialized needs could 
add to the hierarchical tree of subjects, with or without approval of the subscription 
. service provider. 

As discussed above, the content provider will use the software tool to 
attach certain attributes to a cHp file. The software tool will also communicate with a 
master database of video ID numbers to ensure that each clip uploaded, no matter from 
where, will have a unique video ID consistent with tiie present invention. The 
software tool will then upload tiie clip to the content provider's Web server 83, 
allowing the cUp to be registered with the present invention as described in detail 
below. 
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When a content provider changes the content of a video clip, or makes a 
new clip available, the cUp is uploaded to the content provider's Web server 83, and 
information about the data file representing the clip is sent to the IM 90 local to the 
content provider (the "source IM" previously discussed). The clip is then distributed 
to regional IMs and SRUs as follows. 

TTie source IM 90 registers the cUp in its own clip database, storing 
information including the name, date, time, video ID, rating, copyright information. 
subscripUon information, content information, and other attributes of the cUp as the' 
clip is transferred from the content provider to the IM 90. The source IM 90 then 
invokes the IM's storage management logic to copy the file to at least one of its 
extended SRUs 100. The panicular SRU or SRUs chosen can depend on load 
detenninations previously made by the source IM 90, as generally discussed above. 
The Internet address of the chosen SRU 100 is also stored in the cUp database of the 
source IM 90. 

TTie source IM 90 then transfers the updated file to other IMs throughout 
the system. As discussed above, the IM 90 maintains a database of aU other IMs in 
the system, and the types of content such other IMs maintain. ITie receiving IMs 
accept the new clip and subsequenUy transfer it to their respective SRUs. By way of 
the foregoing mechanism, an updated video clip will be sent only to tliose IMs that 
would store such a file. TTie data transfer includes aU of the information listed above, 
plus the Internet address of the source IM 90. The data can be sent by either 
multicasting techniques or by propagation, whereby each IM relays the message to all 
of its neighboring IMs. except the one from which the message was received. The 
multicasting method is preferred, as it results in less utilization of network bandwidth, 
nie propagation method, though robust, can result in a slow response time for data 
updates if many IMs require the new data. 

Each IM has a content database of which categories of content are to be 
made available to the subscribers in its region, reflecting selections made by the 
Internet service provider hosting the IM. The content categories are represented in the 
form of content characterization coordinates, as discussed above. Only those clips in 
the selected categories are stored on the SRUs belonging to the IM. When an IM, 
such as the PIM 64, receives a message about the availability of the new or changed 
cUp, it checks the content database to determine whether it should acquire the file. If 



wo 96/41285 



PCT/US96/10403 



45 

so, the IM wiU send a message to the originating IM 90 indicating that it win store the 
clip. 

Alternatively , content can be distributed without fint sending* a message 
determining which IMs wiU store the clip. To do so, the originating IM will access its 
IM database to determine which IMs have content coordinates that would include the 
new or updated cUp. The list of IMs satisfying that query can then be used for 
distribution of content. 

To distribute the clip to all requesting IMs, the originating IM 90 
utilizes its storage management logic to handle sending the cUp. The originating IM 
90 first reserves a multicast Internet address as designated in the Internet multicast 
standard. The IM 90 then sends a message to each requesting IM, requesting that they 
aU join the multicast group. When the cUp is then sent by the DSI 102 to the reserved 
multicast Internet address, each IM will receive the file and disseminate it to its SRUs 
according to its own criteria. 

Accordingly, each IM (such as PIM 64) then locates the least loaded 
extended SRU to be used for storing the clip (by the means previously discussed) and 
then again invokes its storage management logic to copy the cUp to one of its extended 
SRUs 66. The PIM 64 also checks to determine if it already has an older version of 
the cUp. If so, the storage management logic wiU delete the old version before 
copying the new version to an extended SRU 66. If the cUp has several portions or 
segments (e.g. in different languages or having regionally specific information), only 
those portions indicated as relevant by the IM's content database need be stored. For 
example, if a particular ISP has no Spanish-speaking users, then Spanish language 
versions of clips need not be stored locally. 

The content provider caii also instruct the system to remove all copies of 
a specified cUp. To do so, a message embodying the instrucUon can be sent to the 
coment provider's IM 90. The message will then be propagated throughout the 
system, as indicated above for new and changed cUps. When each IM receives the 
instruction to remove a particular cUp, it will query its clip database to determine if 
any of its extended SRUs are storing the clip. If so, the IM's storage management 
logic will be invoked to delete all copies of the cUp from the appropriate SRUs. 

Each IM. including the PIM 64, also performs its own maintenance on 
the clip database and the data stored on its extended SRUs 66. Periodically, the PIM 
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64 can check to determine if any of the clips in the clip database have expired, or if 
any of the clips have not been accessed within a specified time period (e.g. one hour, 
one day, one week, or one month). If either is the case, the PIM 64 can invoke its 
storage management logic to delete the clips from the appropriate SRUs 66. 

C. Dynanuc Load Management 

To optimize performance, the system of the present invention 
incorporates several means of reducing communications botUenecks: (1) preloading 
and distribution of files based on predicted usage; (2) dynamic load balancing; (3) 
automatic file replacement. The means discussed below are in the natare of on- 
demand paraUeUsm, or enforcing the use of muldple communication paths to reduce 
bottlenecks. However, it should be noted that other load managemem techniques are 
used by the invention, for example the prioritized Ust of extended SRUs 26 created by 
the PIM 64, as discussed above. 

(1) Preloading and Distribution 
The PIM 64 periodicaUy (e.g. hourly) collects and saves in its database 
the frequency with which each file on its extended SRUs 66 is requested as a function 
of day of week and time of day. The frequency of fde access in each of numerous 
pre-defined categories (e.g. sports, automobiles, music, etc.) is tabulated and saved, as 
is the frequency of access of each individual file, and the user's communication link 
speed used for each previous download. The above information is used to predict 
future usage. 

In a preferred embodiment of the present invention, three categories of 
prior usage are utilized to predict the number of times each given cUp will be 
downloaded. First, data based on the historical demand of clips in the cUp's subject 
matter category, over the same hour and same day from previous weeks, is linearly 
extrapolated to predict that category's demand at the present day and time. This first 
factor, by way of example, contributes a fraction of the final weighting, ideaUy 20- 
40%. Second, data based on the particular clip (or its predecessors) over the 
corresponding hour on previous days is linearly extrapolated to predict that clip's 
demand at the present day and time. This second factor contributes 20-30% to the 
final weighting. Third, data based on the particular clip (or its predecessors) over the 



wo 96/41285 



PCT/US96/10403 



47 

period directly preceding the present hour is linearly extrapolated to predict the clip's 
demand. This third factor contributes the remaining fraction, 30-60%, to the fmal 
weighting. 

These three factors are combined to estimate load, i.e, how many times 
each clip will be downloaded in the upcoming period. At the end of each period, 
projected load can be compared to actual load, and techniques known in the art (such 
as neural networks) can be applied to improve the weightings for future periods. 

Based on the projections discussed above, the PIM 64 estimates the SRU 
66 bandwidth required to accommodate the predicted downloads. This estimate can be 
made, for example, by multiplying the size of each file by the number of expected 
downloads in the period. If the projected required bandwidth is less than a threshold 
(e.g. 10-50%) of the capacity of a single SRU 66, then no load balancing need be 
undertaken. However, if the projected required bandwidth is higher, then the fdes 
must be distributed over a sufficient number of extended SRUs 66 until none exceeds 
the threshold. This is accomplished by evenly distributing the highest projected usage 
file over the number of SRUs sufficient to accommodate the number of projected 
simultaneous downloads for the file at the users' projected download speeds. The 
distribution is performed by the storage management logic invoked by the PIM 64 
desiring to distribute files. 

Where there are more copies of files than are predicted to be needed, 
the PIM 64 will use the storage management logic to delete the excess files from those 
SRUs 66 with the highest predicted loads (based on clips other than the one being 
deleted). 

(2) Dynamic Load Balancing 
Dynamic load balancing of the extended SRUs 66 is performed to 
minimize the chances of any particular SRU 66 becoming a bottleneck and to 
maximize bandwidth utilization during periods of peak load. Load balancing in 
accordance with the Internet embodiment of the present invention is carried out 
generally as set forth above for the invention as a whole, and in specific instances as 
described below. 
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The PIM 64 maintains current perfonnance infoimation about each of its 
extended SRUs 66. ITiis information is obtained from determinations of when the DSI 
58 initiates and concludes the transfer of a file from an SRU 66, as discussed above. 

If any SRU has a load approaching a threshold limit (e.g. 80%) of its 
theoretical capacity, the PIM 64 checks whether this is due to a few clips receiving a 
disproportionately large portion (e.g. greater than 10%) of download requests. If so. 
the PIM 64 invoices its storage management logic to transfer the files to another, e.g.' 
the least-loaded SRU 66. 

If the expected or current demand for a particular file or small group of 
files exceeds a threshold capacity (e.g. 30-50%) of all of the extended SRUs 66 within 
a region, the PIM will attempt to move these clips into a RAM (random access 
memory) buffer 106 accessible by the DSI 58. The use of the RAM buffer 106 wiU 
reduce the quantity of disk accesses required to retrieve the highest demand clips. TTie 
deUvery capacity of the SRUs 66 maintained by the PIM 64 wiU then be updated to 
reflect their increased capacity. 

If all of the extended SRUs 66 within a region are unable to meet the 
demand of the current number of users, then the system can make use of remote SRUs 
belonging to neighboring IMs, such as IM 88, as foUows. After the DSI 58 has 
exhausted its attempts to acquire data from the local.SRUs, as generaUy described 
above, the DSI 58 wiU re-query the PIM 64 to obtain a second Ust of viable SRUs. 
As discussed above, the PIM 64 will query the appropriate remote IMs to receive such 
information. 

Because of the invention's dynamic load balancing, should an extended 
SRU 66, remote SRU 92 or 100. or remote IM 88 or 90 fail, alternate servers and 
communication paths are automaricaUy available to service the user. Data is 
maintained redundantly on multiple physical servers. Each region, including its IM 
and extended SRUs, is a self-contained system for managing and distributing video 
cUps; there is no centralized data management function. Consequently, a failure in one 
region does not catastrophicaUy impact any other region. 

Furthermore, as the number of end users to whom the ISP seUs the 
premium service increases, and as the number of available video cUps increases, the 
invention offers potentially unlimited growth capacity. TTie number of physical ' 
extended SRUs 66. as well as the disk capacity of each extended SRU 66, can be 
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increased in order to store more data. Additional IMs can be added to service 
additional geographical regions or to subdivide overloaded existing regions. To 
increase the number of parallel data transfers, more than one DSI 58 can coexist on 
shared physical servers or on separate servers within a region. 

(3) Automatic File Replacement 
The automatic file replacement attributes of the invention are discussed 
above in the section on uploading and distributing new content. 

D. Clip Segmentation 

One embodiment of the present invention can accommodate video clip 
segmentation. In other words, a clip can be made up of two or more segments. After 
selecting a segmented clip, the requesting user can be presented with an index of 
segments within the clip, and choose to download one, several, or all of the segments. 

To accomplish this, the content provider first edits the video clip using 
the software tool described above, so that specific frames of the clip are identified by 
consecutive index numbers. Segment data is attached to the clip and stored within the 
fde. The segment data includes, for each index number, a textual name or description 
of the indexed frame and the starting and ending byte counts of the indexed segment. 
In a preferred embodiment, the user stream of an MPEG file is used to include the 
segment data; in this way, MPEG fde compatibility is maintained for use by other 
players. 

Specifically, segment data will be included within an MPEG fde as 
follows. An MPEG file may possess a number of video streams, a number of audio 
streams, a single MPEG format stream, and a single user stream. The streams are all 
tied together with parameters linking events for use at the same "presentation time." 
Accordingly, segment data of the invention can be merged into the user stream and 
tagged to occur at a specific presentation time corresponding to a desired video or 
audio event. This characteristic is useful for synchronization purposes. 

Furthermore, the user stream can include multiple sub-streams. A 
preferred embodiment of the present invention will have at least two user sub-streams: 
a segment sub-stream and a protection sub-stream. The segment sub-stream will 
contain the index numbers and corresponding data discussed above, as well as a table 
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Of contents to the segments. TTie protection sub-stream wiU contain the protection aiia 
watermarking data discussed above. By the use of multiple speciaUy-defmed sub- 
streams within the user stream of an MPEG file, MPEG viewers other thai the 
browser 82 or browser extension 84 of the invention can be used to view unprotected 
video clips downloaded by the present invention. Such viewers wiU simply ignore the 
additional information. 

Unsegmented clips are generally stored on an SRU 66 as a contiguous 
file on a hard disk belonging to an SRU 66. Segmented clips, however, are stored as 
separately accessible records. The PIM 64 then tracks, in its clip database which 
segments are stored on which SRUs 66. The segment data also remains witiun the 
MPEG file as discussed above. 

When the user requests to view a segmented clip, the clip is identified 
by video ID and located by the PIM 64 as previously discussed for unsegmented clips 
However, before ti^e video data is downloaded, the cUp segment data is downloaded to 
the user terminal 50 for display by the browser extension 84. TTu. user can then select 
the specific segments he wishes to download. The segment numbers of Uie identified 
segments are tiien reported by the browser extension 84 to tiie DSI 58, which tiien 
downloads only the requested segments from the appropriate local SRUs 66 to the 
termmal 50 via tiie local SRU 51. If tiie segments are stored on separate SRUs 66.-ti,e 
DSI 58-can be loading segments concurrentiy from the separate SRUs 66 in 
preparation for download to Uie user teiminal 50. 

niere are other uses for the segment data, as weU. The content 
provider can tie additional information to frames or segments of a clip, m 
information can be stored in an additional control sub-stream (part of tiie MPEG user 
stream previously discussed). For example, the segment data can include additional 
video IDs or URLs identifying other clips or HTML files. When Uie clip is 
downloaded and played by the user's browser extension 84, ti,e browser extension 84 
can then display the associated video ID, URL. or text describing the link The user 
can select one or more of tiiese links, thereby directing tiie browser 82 and/or browser 
extension 84 to acquire ti,e associated information by way of the present invention or 
by traditional means over the Internet 56, 

Hie segment data can also contain embedded instructions for the 
browser extension 84. Such segment data can be included in an additional object sub- 
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Stream made part of the MPEG user stream, as discussed above. For example," by 
including predefined codes associated with particular frames or segments of the clip, 
the browser extension 84 can be instnicted to add graphical objects, text, or other 
controls to the display. Additional computing functionaHty can be added in the fonn 
of embedding terminal-independent computer programs, such as those written in the 
Java pn)giamming language, into the segment database. As the cUp is received by the 
browser extension 84, the program code is also received and interpreted, and can be 
passed to the browser 82. At appropriate times, the browser extension 84 can then 
interact with the browser 82 to cause the appropriate actions to be taken. 

The segments can each have their own attributes, such as content rating 
and language. Such attributes can be stored in the segment sub-stream of an MPEG 
file, as discussed above. Attribute information can be used by the PIM 64 on a per- 
segment basis to determine which segments are available to a particular user. Only 
those segments available wiU be shown on the browser extension 84 as downloadable. 
The PIM;64 wiU instruct the PIM 18 to download only those segmems indicated by the 
information in the user database. Those segments not having relevant data are 
ignored. Thus, the clip file stored on the extended SRUs 66 is dynamicaUy 
decomposed to eliminate undesired content and reconstmcted to provide the desired 
video clip to the user. 

Note that the segmented files can be stored as segments on the contem 
provider's Web server 83. as weU. When the presem system is not available (e.g., the 
user has insufficiem subscription rights or a particular cUp has not been stored on any 
SRUs), a Web page can be used to Ust the individual segments, with the segments 
selectable as separate cUps in a traditional manner oyer the Internet 56. 

E. Subscription Control and Management 

As discussed above, the present invention can be a premium service for 
subscribers. Consequently, the foUowing subscription inanagement capabilities are 
included when needed. 

To receive access to the present invention, the end user must subscribe 
to the premium service. The subscription may be free. The ISP provides the user 
with a sign-up program (which may be implemented as a Web page on the ISP's Web 
server 68 having forms to receive data input). The user is queried as to price limits 
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for monthly charges, and provides billing information (such as a credit c^ numbei)— 
User configuiation data is collected, such as the desired playback quality and resolution 
of video clips. The user also establishes acceptable content restrictions for use in the 
ratings system discussed below. By using the sign-up program or accessing the sign- 
up Web page in the future, the user has access to the configuration data to alter it as 
desired. 

For content that is available on a subscription basis, the invention limits 
access to those users who are designated as subscribers to the content. Users may 
directly subscribe to particular content, or ISPs may subscribe for their end users. In 
either case, the PIM 64 maintains in its user database a Usting of aU those authorized 
subscribers who are connected to the PIM 64. limiting downloading of clips through 
the mvention to those who are authorized within that region. 

Each video cUp can also be amiotated with a date or elapsed time after 
which it will expire; such information will be stored in the clip database belonging to 
the PIM 64. The PIM 64 will then disallow transmission of an expired fde to any 
user's browser extension 84, and can optionaUy disallow replaying (i.e. decline a 
request to un-pretect) a clip stored locaUy at the user's terminal 50. 

Certain clips can be made available on a "pay per view- basis. In such 
a case, each download (or, optionaUy. each viewing) wiU be tracked by the PIM 64- 
the user's account accrues an incremental charge on the basis of the download or 
viewmg. The browser extension 84 can alert the user to the requested charge in order 
to get authorization for the clip's download. 

A mechanism is buUt into the invention to avoid abuse of the "pay per 
view billing system. With a pay per view system, there is a potential for a user to 
over-use the system, accruing an unreasonably high level of charges. Consequently 
the user or another person can pre-program the browser extension 84 to enforee a c^st 
limit; this cost limit would be password prx)tected. Prior to downloadmg a file the 
PIM 64 communicates the total potential cost to the browser extension 84. If the total 
charge exceeds the player's limit, then the download is disallowed, or the user is asked 
to confirm the transaction by entering the password. 

An alternate form of billing can be made in the form of subscription 
fees, me content provider can require that a periodic subscription fee be paid for a 
user to receive access to a selected group of video clips. Such subscribed access can 
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then be unlimited or limited as the content provider or ISP desires. This billing 
scheme can be used in conjunction with the "pay per view" scheme disclosed above; 
some clips might be free with an appropriate subscription, while others are'still 
available only through pay per view. If certain downloaded cUps had to be retrieved 
from remote regions 89 or 91, then a "long distance" charge can be assessed. The 
PIM 64 can track the accrual of periodic subscription fees and apply the charges to the 
accounts of the users in its region 81. 

As suggested above, a subscription can be limited to certain subject 
areas of interest. The user can use the browser extension 84 and browser 82 to search 
the Web for topics of interest; such search capabilities are known in the art. When a 
coUection of desired cUps has been determined, the user can use the browser extension 
84 to submit a proposed group of clip requests to the PIM 64. The PIM 64 can then 
respond with information on proposed subscription terms and fees to accommodate the 
query results. The user can accept or reject such terms, and upon acceptance, the 
user's account will be updated accordingly. 

The present system also accommodates various ratings for use in, for 
example, parental control. When content is created or uploaded to the content 
provider's Web server 83 and its IM 90, the content provider can assign a rating level, 
which will be stored in the clip database of the IM 90 (and the PIM 64), as weU as 
optionally in the Web page containing the cUp. The player can be pre-programmed by 
the user or another person to disallow downloading video clips having ratings higher 
than a specified limit; the rating control programming can be protected by password. 
Each cUp can be rated, for example, by a two-dimensional rating matrix consisting of 
a characteristic and severity. In one embodiment, the characteristics would be nudity, 
pornography, language, and violence; leveU of severity can be, for example, from one 
to five. 

Under the rating control mechanism, when a video clip is requested by 
die user, the PIM 64 is provided the rating information either from the Web page (as 
part of the tag embedding the video ID) or from the clip database on the PIM 64, after 
the PIM 64 has identified the cUp. The user's rating control limit is sent to the PIM 
64 as part of the virtual URL constructed from the video ID, The PIM 64 can then 
allow or deny the download based on that information. 
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Example R - Alternative Embodiment); — - 

In view of the above explanation of the exemplary system, it will be 
appreciated that embodiments of the present invention may be employed ij^ many 
different applications to deUver large quantities of time-critical data across a network. 
Specifically, it should be noted that the foregoing disclosure is not limited to video 
cUps, with or without audio, and would also perform weU for audio-only cUps, and 
computer data, among other data types. Similarly, the functional elements disclosed 
herein are not limited structurally to the configuration shown; it is contemplated that 
the elements, such as the PIM 64 and the DSI 58. among others, can share hardware 
on a single server, if such is desirable or necessary in a particular embodiment. 
Alternatively, a fiinctional element may be spUt over several pieces of hardware to 
improve performance, as is known in the art. Also, note that while only three regions 
are depicted and disclosed in Figure 4, the present invention is scalable, with many 
regions comiected by the Internet 56 (or any other network) and high-speed lines (like 
line 96); each region is likewise expected to have a large number of users connected to 
its respective head-end network interface 54 

WhUe certain exemplary structures and operations have been described 
herein, the appropriate scope hereof is deemed to be in accordance with the claims as 
set forth below. 
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What is claimed isr 

^ 1. A video clip storage and retrieval system comprising: 

a multimedia terminal through which a user may reques*t video 
cUps from a database, the multimedia terminal also being able to receive and display 

4 requested video clips; 

5 a local storage and retrieval module which communicates with 

6 the multimedia terminal and which is adapted to receive and process video clip 

7 requests from the multimedia terminal; 

8 a primary index manager which communicates with the local 

9 storage and retrieval module and which is adapted to receive and process video cUp 
10 requests from the local storage and retrieval module; 

^ ^ ^ extended storage and retrieval module which communicates 

12 with the primary index manager, and which stores a plurality of databases including a 

13 database containing video clips; 

^ data sequencing interface controlled by the primary index 

15 manager and adapted to direct the extended storage and retrieval module to download 

16 the requested video clips; and 

means for downloading the requested video clips to the 
18 multimedia terminal via the local storage and retrieval module. 

1 2. The video clip storage and retrieval system as in claim 1 further 

2 comprising a plurality of multimedia terminals to accommodate a plurality of users, 

^ 3. The video clip storage and retrieval system as in claim 1 wherein 

2 a pluraUty of extended storage and retrieval modules are connected to the primary 

3 index manager. 

1 4. The video clip storage and retrieval system as in claim 1 wherein 

2 the primary index manager is further connected to a plurality of remote index 

3 managers. 
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^ ^- Video cUp Storage and retrieval system as in claim "4 wherein 

the primaiy index manager and each remote index manager maintains a list of every 

3 video clip stored at the extended storage and retrieval units. 



2 



1 6. The video clip storage and retrieval system as in claim 4 ftirther 

2 comprising means for the local storage and retrieval module to attach a regional 
identifier to each requested video cUp before the request is transmitted to the primary 

4 index manager. 



3 



1 7. 



2 



The video clip storage and retrieval system as in claim 5 wherein 



the primary index manager uses the regional identifier to identify remote index 



3 managers containing the requested video clips. 

^ ^- '^^ v''^^ clip storage and retrieval system as in claim 5 further 

2 comprising: 

means for searching the local storage and retrieval module to 
detemine whether the requested video clips are stored therein; and 

means for modifying the user request to indicate whether the 
6 requested video clips are so stored. 

1 9. The video clip storage and retrieval system as in claim 1 wherein 

2 the videos are stored in compressed form and the multimedia terminal includes 

3 decompression means to allow the user to view the video clip at the multimedia 

4 terminal, 

1 10. The video cUp storage and retrieval system as in claim 1 wherein 

2 the local search and retrieval module contains decompression means for downloading 

3 the requested video clips to the user terminals. 

1 1 1 . The video clip storage and retrieval system described in claim 3 

2 wherein the data sequencing interface contains means for sequencing information 

3 received from the pluraUty of extended storage and retrieval module. 
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1 12. A video clip storage and retrieval system according to claim 1, 

2 wherein the user may request clips from a database at least one of real estate, 

3 pharmaceutical, retail sales, travel, and personnel information. ' 

1 13. The video clip storage and retrieval system as in claim 12 

2 wherein the database contains real estate information and the regional identifier is one 

3 of a ZIP code, cartesian coordinate, and GPS coordinate. 

1 14. A method for storing and retrieving an audio-visual clip from a 

2 database comprising the steps of: 

3 searching through the database to select audio-visual clips for 

4 viewing and formulating a request for the selected audio-visual cUps; 

transmitting the request for audio-visual clips from a user's 

6 multimedia terminal to a local search and retrieval module; 

^ searching the local search and retrieval module to determine 

8 whether the requested audio-visual cUps are stored therein; 

9 modifying the request within the local search and retrieval 

10 module to indicate whether the requested audio-visual cUps are stored therein, and by 

1 1 appending a regional identifier to each requested, audio-visual cUp; ^ 

transmitting the modified request to a primary index manager; 
"Sing the primary index manager to determine the exact storage 

14 location of each audio-visual cUp within one or more extended search and retrieval 

15 modules; 

creating and maintaining a data sequeiicing interface to direct the 

17 extended search and retrieval modules to download the requested audio-visual cUps to 

18 the data sequencing interface; 

downloading the audio-visual clips to the user's multimedia 
20 terminal via the local search and retrieval module; and 

decompressmg the audio-visual cKps from its compressed state 
22 for viewing at the user's multimedia terminal. 
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1 15. A distributed video clip storage and retrieval system comprising: 

2 a plurality of video storage media at different geographic locations; 

3 a plurality of digitized video clips, each of which is stored in one or 

4 more copies by the storage media at one or more locations; 

5 a user interface comprising a video display terminal for requesting and 

6 viewing desired video clips; 

7 a search engine for locating video clips requested via the user interface 

8 and residing on the video storage media; 

9 at least one user-specific buffer for retrieving and forwarding one or 

10 more located video clips to the user interface; 

1 1 a first communications channel linking user interface and the search 

12 engine; 

a second communications channel linking the search engine and the 

14 storage media; 

15 a third communications channel linking the storage media and the user- 

16 specific buffer, 

1'^ a fourth communications channel, linking the user-specific buffer and the 

18 user interface; and 

a storage engine for distributmg the video clips on the storage media at 
20 one or more Ideations* on a supply and demand basis. 

1 16. A distributed video cUp storage and retrieval system according to 

2 claim 15, wherein the first, second and fourth communications channels are each one 

3 of very high speed and high speed, and the third communications channel is very high 

4 speed. 

1 17. A distributed video clip storage and retrieval system according to 

2 claim 16, wherein each very high speed channel uses a protocol selected from the 

3 group consisting of FDDI and ATM and each high speed channel uses an ISDN 

4 protocol. 

1 18. A distributed video cUp storage and retrieval system according to 

2 claim 16 wherein each very high speed channel has a minimum bandwidth of at least 
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3 about 100 mbaud, and each high speed channel has a minimum bandwidth of at least 

4 about 56 kbaud. 

1 19. A distributed video clip storage and retrieval system according to 

2 claim 15, wherein each video clip and each storage media is uniquely identified, and 

3 each storage media comprises a file sender having a digital memory and a database of 

4 the video clips stored in and retrieved from its digital memory. 

1 20. A distributed video clip storage and retrieval system according to 

2 claim 19, wherein each file server has one or more memory devices, each of which is 

3 independently selected from the group consisting of high capacity hard drives, high 

4 speed optical drives, RAID devices, and WORM drives. 

1 21. A distributed video clip storage and retrieval system according to 

2 claim 15, wherein each video clip is stored in a compressed fonnat, and is 

3 decompressed for display. 

1 22. A distributed video clip storage and retrieval system according to 

2 claim 21, wherein video decompression occurs at one of the user-specific buffer and 

3 the user interface. 

1 23. A distributed video clip storage and retrieval system according to 

2 claim 21, wherein the compression format is one of MPEG I, MPEG n, MJPEG, 

3 Indio and Fractal. 

1 24. A distributed video clip storage and retrieval system according to 

2 claim 15 wherein the user interface resides on a personal computer and includes a 

3 search interface and an audio-visual display interface. 



1 
2 
3 



25. A distributed video clip storage and retrieval system according to 
claim 24, wherein the user interface provides for further processing and manipulation 
of retrieved video clips. 
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1 26, 
2 



A distributed video clip storage and retrieval system according to 
claim 15 wherein the user-specific buffer delivers video clips to a local storage media 
- for storing retrieved video clips. • 

1 27. A distributed video clip storage and retrieval system according to 

2 claim 26. wherein the most frequenUy requested video cUps are stored in the local 

3 storage media, 

1 28. A distributed video clip storage and retrieval system according to 

2 claun 15. wherein the user interface and user-specific buffer independently reside on 
one of a fde server and personal computer associated with one of the plurality of 

4 storage media. 



' . ''^^^''"*^"^^«'^'^P«°^g«^d retrieval system according to 

2 claim 15. wherein the search engine accesses one or more databases having 

- '^^""-tion describing Video clips stored on the system and their stonge locations 



3 



30. A distributed video clip storage and retrieval system according to 
claim 29. wherein at least one of the databases resides on one of the plurality of 

3 storage^media, ^- 

I ^^"^''^"'^ideo clip storage and retrieval system according to 

clami 30. wherein another of the databases resides on an independent on-line service. 



3 



1 



32. A distributed video clip storage and retrieval system according to 
claim 15. wherein the user interface includes local search and update logic, for 
retrieving the most current information. 



2 1- ... ""^'^'"^^"'"^^"P^^^-Se and retrieval system according to 

2 claim 15. addiUonaUy comprising a unique system address and a communications 

3 gateway to one or more remote video clip storage and retrieval systems according to 

4 claim 15. * 
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1 34. A distributed video clip storage and retrieval system according to 

2 claim 15, wherein the search engine comprises a communications interface, user- 

3 specific buffer logic, database management logic, storage management logic, and 

4 message routing logic. 

1 35. A distributed video clip storage and retrieval system according to 

2 claim 34, wherein the user-specific buffer logic determines the local availability of 

3 requested video clips, the database management logic determines the system-wide 

4 availability of requested video clips, the storage management logic determines the 

5 location and distribution of video clips stored on the system, and the message routing 

6 logic determines the communications chaimels for movement of queries and video clips 

7 throughout the system. 

1 36. A distributed video clip storage and retrieval system according to 

2 claim 15, wherein each video clip is stored in contiguous blocks of memory. 

1 37. A data sequencing interface for collecting, managing and 

2 buffering audio-visual data which is transmitted to the data sequencing interface from 

3 extended and remote storage locations for downloading to a user, comprising: 

4 a first communications interface between an index manager and 

5 the data sequencing interface for communicating the exact location of audio-visual 

6 segments stored at one or more of the extended and remote storage locations; 

7 a second communications interface between the extended and 

8 remote storage locations and the data sequencing interface for transmitting the 

9 downloaded audio-visual segments to transmit buffers of the data sequencing interface; 

10 audio-visual sequencing logic for sequentially requesting each 

11 audio-visual segment from each extended and remote storage location identified as 

12 containing the audio-visual segment until the audio-visual segment is retrieved; 

13 storage management logic for managing the location of each 

14 retrieved audio-visual segments; and 

15 a third communications interface between the data sequencing 

16 interface and the user over which the retrieved audio-visual segments is transmitted for 

17 the eventual download to the user. 
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38. The data sequencing interface as in claim 37 wherein: 
^ the first and second communications interface are very high 



3 speed; and 
4 

1 



the third communications interface is a high speed. 



39. The data sequencing interface as in claim 38 wherein each very 

2 high speed interface has a minimum bandwidth of at least about 100 MBaud, and each 

3 high speed interface has a minimum bandwidth of at least about 56 Kbaud. 

1 40. nie data sequencing interface as in claim 37 wherein the storage 

2 management logic comprises: 

means for determining whether an audio-visual segment is 
retrieved from either one of the remote storage location or from the extended storage 



3 
4 

5 location; 
6 
7 



means for comparing the number of times an audio-visual 
segment is retrieved from a remote storage location with the number of times the least 

8 requested audio-visual segment is retrieved from the extended storage location; 

9 means for copying, from the remote storage location to the 

10 extended storage location, an audio-visual segment which is retrieved more often from 

11 the remote storage location than from the extended storage location; and "~ 

'"^s for removing the least requested audio-visual segment 

13 from the extended storage location and placing the least requested audio-visual segment 

14 onto one of the remote storage locations. 

1 41. The data sequencing Interface as in claim 37 wherein the audio- 

2 visual sequencing logic comprises: 

means for determining whether an audio-visual segment requested 
from either the extended or remote storage location camiot be retrieved because of 
other requests for audio-visual data from that extended or remote storage location; 

means for requesting the audio-visual segment from another 
extended or remote storage location; 

means for communicating which storage location provided the 
9 audio-visual segment to the index manager. 



3 
4 
5 
6 
7 
8 
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1 42. A distributed video clip delivery system comprising: 

a multimedia terminal through which a user may request video 
clips from a clip database, wherein said multimedia terminal is connected td a networic 
and is able to receive and display requested video clips via said network; 

a plurality of extended storage and retrieval units connected to 
6 said network, each storing a plurality of video clips; 

a prmiary index manager which communicates with the 
multimedia tenninal via said network and which is adapted to receive and process 
9 video cUp requests from said multimedia terminal; and 

a sequencing interface controlled by said primary index 

1 1 manager and adapted to direct said extended storage and retrieval units to download 

12 said requested video clips to said multimedia terminal. 



8 



1 



43. The distributed video clip deUvery system of claim 42, wherein 



2 said network is the Internet. 

1 44. The distributed video cUp delivery system of claim 42 further 

2 comprising a plurality of multimedia terminals to accommodate a plurality of users. 

1 45. The distributed video clip deUvery system of claim 44 further 

2 comprising a plurality of primary index managen to accommodate a plurality of users. 

1 46. The distributed video clip deUvery system of claim 45, wherein 

2 each of said multimedia terminals is associated with a single primary index manager. 

1 47. The distributed video cUp deUvery system of claim 46, wherein a 

2 plurality of said multimedia terminals is associated with each of said primary index 

3 managers. 

1 48. The distributed video cUp deUvery system of claim 42, wherein 

2 said multimedia terminal is connected to said network via a head-end interface. 
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1 49. The distributed video clip delivery system of claim 48, wherein 

2 said data sequencing interface is connected directly to said head-end interface. 

1 50. The distributed video clip delivery system of claim 49, wherein 

2 each of said extended storage and retrieval units is connected to said data sequencing 

3 interface. 

1 51. The distributed video clip delivery system of claim 50, further 

2 comprising a plurality of remote storage and retrieval units, each storing a pluraUty of 

3 video clips, connected to said network. 

1 52. The distributed video clip delivery system of claim 42, wherein 

2 said primary index manager maintains a user database containing informaUon on all 

3 authorized users. 

1 53. The distributed video clip delivery system of claim 42, further 

2 comprising a browser program running on said multimedia terminal. 

1 54. The distributed video clip deUvery system of claim 53, further, 

2 comprising a browser extension program running on said multimedia terminal, capable 

3 of interacting with said browser program. 

1 55. Hie distributed video clip delivery system of claim 42, wherein 

2 said multunedia terminal further comprises a storage buffer for temporary storage of 

3 downloaded clips. 



^ The distributed video cUp delivery system of claim 42, wherein 

2 said data sequencing interface includes a RAM buffer adapted'for the temporary 

3 storage of clips queued for downloading. 



I 
2 
3 



57. A method for distributing a video clip over a network to a user 
having a multimedia terminal, comprising the steps of: 
browsing a network; 
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4 identifying a video clip of interest; 

5 searching a user database to retrieve user information 

6 corresponding to said user, * 

7 searching a clip database to retrieve clip information 

8 corresponding to said video clip of interest; 

9 matching the user information to the clip information to 
10 determine if the user is authorized to receive said clip; 

1^ analyzing the clip information to determine where the clip is 

12 stored; 

13 directing a data sequencing interface to download the clip from 

14 its storage location; and 

15 downloading the clip to the user. 

1 58. The method of claim 57, further comprising the step of viewing 

2 the clip on a multimedia terminal. 

1 59. The method of claim 58, further comprising the step of storing 

2 the clip on a local storage and retrieval unit. 

1 60, The method of claim 58, further comprising the step of updating 

2 the user database to reflect additional charges incurred by the user for the download. 

1 61. The method of claim 58, further comprising the step of 

2 protecting the clip prior to downloading the clip. 

1 62. The method of claim 61, further comprising the step of 

2 unprotecting the clip prior to viewing the clip. 



1 
2 



63. The method of claim 62, further comprising the step of 
decompressing the clip prior to viewing the clip. 



wo 96/41285 



PCT/US96/10403 



66 

1 64. The method of claim 57, further comprising the step of 

2 detemiining whether the cUp is stored at a local storage and letrieval unit before 

3 directing a data sequencing interface to download the clip. ' 

1 65. The method of claim 64, wherein said cUp is not downloaded if it 

2 is already stored at the local storage and retrieval unit. 

1 66. The method of claim 65, wherein said clip is replayed on the 

2 multimedia terminal. 

1 67. The method of claim 64, wherein said clip is replayed only if 

2 authorization is received from a primary index manager. 

1 68. TTie method of claim 67, wherein said authorization is based on 

2 information in the user database and information in the clip database. 

^ The method of claim 57, wherein said user database is 

2 maintained by a primary index manager. 

1 70. The method of claim 69, wherein said clip database is maintained 

2 by said primary index manager. 

1 71. The method of claim 70, wherein said searching, matching, 

2 analyzing, and directing steps are performed by said primary index manager. 

1 72. The method of claim 57, wherein said downloading step is 

2 performed by a data sequencing interface. 

1 73. The method of claim 71, wherein said identifying step is 

2 performed by the user directing the browser to send a request message to said primary 

3 index manager. 
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1 74. The method of claim 73, wherein said request message comprises 

2 portions identifying the user and the requested video clip, 

1 75, The method of claim 74, wherein said request message is in the 

2 form of a text string specifying the Internet address of the primary index manager, 
identifying the user, and uniquely specifying the identity of the requested video clip. 



3 



1 76. The method of claim 71 , further comprising the step of 

2 determining whether the clip is stored on an extended storage and retrieval unit prior 

3 to directing a data sequencing interface to download the clip. 

1 77. The method of claim 76, further comprising the step of querying 

2 neighboring index managers to determine where the cUp is stored if the cUp is not 

3 stored on an extended storage and retrieval unit. 

1 78. The method of claim 76, wherein said data sequencing interface 

2 is invoked on a computer directly connected to said extended storage and retrieval unit 

3 if the clip is stored on said extended storage and retrieval unit, 

1 79. The method of claim 77, wherein said data sequencing interface 

2 is invoked on a computer directly connected to the storage and retrieval unit where the 

3 clip is stored, 

^ The method of claim 77, further comprising the step of querying 

2 the source index manager to determine where the clip is stored if the clip is not stored 

3 on a storage and retrieval unit local to said neighboring index managers. 

1 81, The method of claim 80, wherein said data sequencing interface 

2 is invoked on a computer connected to the storage and retrieval unit where the cHp is 

3 stored. 



1 

2 



82, The method of claim 76, further comprising the step of 
determining a fastest download path if the clip is stored on more than one extended 
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3 storage and retrieval unit, and wherein said data sequencing interface is directed to 

4 download the clip over said fastest download path. 

.1 83. The method of claim 79, further comprising the step of 

2 detennining a fastest download path if the clip is stored on more than one extended 

3 storage and retrieval unit, and wherein said data sequencing interface is directed to 

4 download the clip over said fastest download path. 

1 84. The method of claim 57, wherein the user is informed if it has 

2 been detennined that the user is unauthorized to receive the clip. 

1 85. The method of claim 84, wherein the downloading is tenninated 

2 if it has been determined that the user is unauthorized to receive the clip. 

V method of claim 82, further comprising the step of 

2 detennining and utilizing an alternate download path if said fastest download path is 

3 unavailable. 

1 87. The method of claim 86, wherein said fastest download path is 

2 deemed unavailable if the downloading step is not able to be perfoimed within a 

3 predetermined timeout period after the directing step. 

} The method of claim 57, further comprising the step of 

2 subscribing to desired content. 

1 89. The method of claim 88, further comprising the step of 

2 generating custom Web pages based on said desired content, wherein said custom Web 

3 pages include links to subscribed clips. 

1 90. The method of claim 89, wherein said identifying step is 

2 performed by the user selecting a link on one of said custom Web pages. 
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1 91 . The method of claim SSrfiirther cbiiiprising the step of updating 

2 the user database to reflect a periodic subscription fee. 

1 92. The method of claim 57, wherein said matching step includes 

2 comparing a rating attribute in said clip information to a rating limit in said user 

3 information. 

1 93. The method of claim 57, further comprising the step of making 

2 clips available on said network. 

1 94. The method of claim 93, wherein said step of making clips 

2 available comprises the substeps of: 

3 uploading a clip to a Web server; 

4 registering the clip with an index manager corresponding to the 

5 Web server; 

6 determining which selected index managers on the network wiU 

7 store the clip; 

8 passing the clip to said selected index managers; and 

9 loading the clip to selected extended storage and retrieval uiifs 

10 and registering the cUp with the index manager corresponding to each such extended 

1 1 storage and retrieval unit. 

1 95. The method of claim 94, wherein said passing step comprises 

2 multicasting the clip to said selected index managers. 

1 96. The method of claim 94, wherein each index manager determines 

2 whether to load the clip to its corresponding storage and retrieval units. 



1 97. The method of claim 95, wherein the determination is made 

2 the basis of a content database maintained by the index manager. 

1 98. The method of claim 57, further comprising the step of 

2 distributing clips for efficient network utilization. 



on 
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1 99. The method of claim 98y wherein said distributing step comprises 

2 the substeps of: 

3 calculating a first predicted usage of clips for an upcoming period 

4 in a given subject area based on historical usage at the same time on previous days and 

5 on the same day in previous weeks; 

6 calculating a second predicted usage of clips for an upcoming 

7 period based on historical usage at the same time on prior days; 

8 calculating a third predicted usage of clips for an upcoming 

9 period based on historical usage in immediately preceding time periods; 

10 combining said predicted usages to determine, for each clip, an 

1 1 overall predicted usage in the upcoming period; 

12 estimating the bandwidth required to accommodate the predicted 

13 usage; 

1* determining which popular clips contribute most to the predicted 

15 usage; and 

1^ moving said popular clips to distribute the load if the estimated 

17 bandwidth exceeds a threshold. 



I 
2 



1 
2 



100. The method of claim 99, wherein said combining step utilizes the 
following weightings: 20-40% for the first predicted usage; 20-30% for the second 



3 predicted usage; and 30-60% for the third predicted usage. 

1 101, The method of claim 99, wherein said threshold is 10-50% of 

2 theoretical bandwidth capacity without slowing. 



102. The method of claim 99, wherein the moving step comprises 
distributing said popular clips over a number of extended storage and retrieval units 



3 capable of accommodating the predicted usage. 



1 

2 
3 



103. The method of claim 82, further comprising the step of 
communicating to the primary index manager the delays experienced in transmitting 
the clip. 



wo 96/41285 . 



PCT/US96/10403 



71 

1 104. The method of claim 103, wherein said primary index manager 

2 tracks the apparent load experienced by each of its extended storage and retrieval units. 

1 105. The method of claim 104, wherein said primary index manager 

2 directs the redistribution of an extended storage and retrieval unit's clips if the 

3 extended storage and retrieval unit's apparent load is greater than a first threshold. 

1 106. The method of claim 105, wherein said first threshold is 

2 approximately 80% of theoretical bandwidth capacity without slowing. 

1 107. The method of claim 105, wherein said primary index manager 

2 directs that popular clips be loaded into a RAM buffer if an extended storage and 

3 retrieval unit's apparent load based on said popular clips is greater than a second 

4 threshold. 

1 108. The method of claim 107, wherein said second threshold is 30- 

2 50% of theoredcal bandwidth capacity without slowing, 

1 109. The method of claim 107, wherein said primary index manager 

2 directs that clips be downloaded from remote storage and retrieval units associated with 

3 neighboring index managers if the data sequencing interface is unable to download 

4 from any extended storage and retrieval unit. 

1 110. The method of claim 109, wherein said apparent said remote 

2 storage and retrieval units are identified by the data sequencing interface by querying 

3 the primary index manager. 

1 111. The distributed video clip delivery system of claim 42, wherein 

2 certain video clips comprise a plurality of segments. 



1 

2 



112. The distributed video clip delivery system of claim 111, wherein 
said segments are indicated by segment data associated with a segmented clip. 
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1 113. The distributed video clip delivery system of claim 112, wherein 

2 said segment data comprises textual information associated with each segment. 

1 1 14. The distributed video clip delivery system of claim 113, wherein 

2 said segment data comprises Internet addresses associated with each segment. 

1 115. The distributed video clip delivery system of claim 114, wherein 

2 said segment data identifies additional video clips. 

1 116. The distributed video clip delivery system of claim 112, wherein 

2 said segment data is stored by said primary index manager. 

1 117. The distributed video cUp deUvery system of claim 116, wherein 

2 said segmented clip is stored as a plurality of files on said extended storage and 

3 retrieval units. 

1 118. The method of claim 57, further comprising the steps of: 

2 determining whether the cKp is segmented; and if the cUp is segmented, informing the 

3 user of such and awaiting instructions on which segments are desired; 

4 and wherein the downloading step downloads only the desired segments. 

1 119. The method of claim 57, further comprising the stqjs of: 

2 determining whether the clip is segmented; 

3 calculating which segments are desired by accessing data in the user database; 

4 and wherein the downloading step downloads only the desired segments. 

1 120. The system of claim 55, wherein said storage buffer comprising a 

2 local storage and retrieval unit interposed between said terminal and said interface. 



1 

2 



121. The system of claim 120, wherein said local storage and retrieval 
unit maintains a local database of video clips as space permits. 
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1 122. The system of claim 121, wherein said multimedia terminal can 

2 access said local database alternatively to receiving video clips by said network. 

1 123. The method of claim 75, wherein said request message is 

2 embedded in a Web page. 

1 124. The method of claim 112, wherein said segmented clip is an 

2 MPEG file. 

1 125. The method of claim 124, wherein said segment data is stored in 

2 a user segment belonging to said MPEG file. 

1 126. The method of claim 61, wherein said protecting step comprises 

2 the sub-steps of: 

3 identifying key data fields within the clip; 

4 encrypting the contents of the key data fields; 

5 storing the encrypted contents within said clip; and 

6 replacing the key data fields with falsified contents. 

1 127, The method of claim 126, wherein said protecting step further 

2 comprises the sub-steps of: 

3 generating a user watermark based on the information 

4 corresponding to said user; and 

5 storing the user watermark within said clip. 

1 128. The method of claim 126, wherein said clip is an MPEG file, 

2 and wherein the encrypted contents are stored within a user stream belonging to the 

3 MPEG file. 

1 129. The method of claim 127, wherein said clip is an MPEG file, 

2 and wherein the user watermark is stored within a user stream belonging to the MPEG 

3 file. 
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130. The method of claim 126, wherein said unprotecting step 
comprises the substeps of: 

identifying key data fields within the clip; 

locating where the encrypted contents are stored; 

decrypting the encrypted contents; and 

replacing the key data fields with the decrypted contents. 
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